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Chapter 1 

Why is water wet? 




Statistical mechanics is the attempt to explain the properties of matter from first principles. 

In the framework of the phenomenological theory of energy and matter, in Thermodynamics, 
these properties were measured and interrelated in a logically consistent manner. The resulting 
theoretical body allowed scientists to write up exact relations between measured properties. 
However, as long as the molecular or atomic nature of matter was not included in the theory, a 
complete prediction of the numerical values of these observables was impossible. 

To take an example: the entropy difference Si, 2 between two states of a system was opera- 
tionally defined as the integral S2 — Si = /, dQ/T (assuming a reversible path from 1 to 2), but 
the numerical value of S could not be predicted even for an ideal gas. Similarly, thermodynamic 
reasoning shows that the difference between the specific heats Cp and CV must exactly equal 
Cp — Cv = TV a 2 1 kt, where a and kt are the expansions coefficient and the isothermal com- 
pressibility, respectively; but a specific value for Cp or CV cannot be predicted. 

Let us dream for a moment: what if we could calculate, say, the entropy S of a piece of matter 
on the basis of microscopic considerations? Assuming we could find an explicit expression for 
S(E, V) - entropy as a function of energy and volume - then this would give us access to all the 
riches of thermodynamic phenomena. All we would have to do is take the inverse function E(S, V) 
and apply the thermodynamic relations T = -{3E/dS) v , C v = (OE/dT) v , P = -(dE/dV) s 
etc. 

Our project then is to describe the mechanics of an assembly of many (w 10 24 ) particles with 
mutual interactions. The only way to do this is by application of statistical methods: a rigorous 
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analysis of the coupled motions of many particles is simply impossible. 

It should be noted, however, that with the emergence of fast computing machines it became 
possible to perform numerical simulations on suitable model systems. It is sometimes sufficient 
to simulate systems of several hundred particles only: the properties of such small systems differ 
by no more than a few percent from those of macroscopic samples. In this manner we may 
check theoretical predictions referring to simplified - and therefore not entirely realistic - model 
systems. An important example are "gases" made up of hard spheres. The properties of such 
gases may be predicted by theory and "measured" in a simulation. The importance of computer 
simulation for research does not end here. In addition to simple, generic models one may also 
simulate more realistic and complex systems. In fact, some microscopic properties of such systems 
are accessible neither to direct experiment nor to theory - but to simulation. 

In the context of this course simulations will be used mainly for the visualisation of the 
statistical-mechanical truths which we derive by mathematical means. Or vice versa: having 
watched the chaotic buffeting of a few dozen simulated particles we will courageously set out to 
analyse the essential, regular features hidden in that disorderly motion. 

Thus our modest goal will be to identify a microscopic quantity that has all the properties 
of the thing we call entropy. For a particularly simple model system, the ideal gas, we will even 
write down an explicit formula for the function S(E, V). Keeping our eyes open as we take a 
walk through the neat front yard of ideal gas theory, we may well learn something about other, 
more complex systems such as crystals, liquids, or photon gases. 

The grown-up child's inquiry why the water is wet will have to remain unanswered for some 
more time. Even if we reformulate it in appropriate terms, asking for a microscopic-statistical 
explanation for the phenomenon of wetting, it exceeds the frame of this introductory treatment. 
- And so much the better: curiosity, after all, is the well spring of all science. 

1.1 A quick resume of thermodynamics 

• Thermodynamic state — State variables 

We can describe the state of a thermodymic system uniquely by specifying a small number 
of macroscopic observables (state variables) Xc 

amount of substance (in mol) n; pressure P; volume V; temperature T; internal energy E; 
etc. 

Equations of state of the form Form f(Xi,X2,--) — serve to reduce the number of 
independent state variables: 

PV = nRT; E = nC v T (ideal gas); (P + an 2 /V 2 )(V - bn) = nRT (real gas; Van dcr 
Waals); etc. 

• First Law 

Joule's experiment (heat of friction: stirring water with a spindle driven by a weight) 
proved that heat is a form of energy. Mechanical energy (W) and heat (Q) may be converted 
both ways. Following general custom we assign a positive sign to mechanical work performed 
by the system, while heat is counted positive when it is fed into the system. The law of 
energy conservation then reads, taking into account the internal energy E, 

dE = dQ-dW (1.1) 

Frequently the mechanical energy occurs in the form of "volume work" , i.e. work performed 
against the ambient pressure when the system expands: dW = P dV (piston lifting weight). 
It should be noted that E is a state variable, while Q and W may depend not only on the 
state of the system but also on the way it has reached that state; we may stress this by 
using the notation dE = dQ — dW. 1 

Internal energy of an ideal gas: The expansion experiment (also by Joule: expand air from 

1 Quantities such as Q and W are often called process variables. 
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one bottle into an additional, evacuated bottle) demonstrates that E^g = CV T, meaning 
that the internal energy of an ideal gas depends only on the temperature T. (Do not confuse 
this with Joule and Thompson's throttling experiment, which relates to real gases.) 

Since AW = we have AE = AQ; but as T 2 = Ti (empirical fact) there follows 
AQ oc AT = 0. Thus AE = 0. However, since the volumes of final and initial state 
differ, the internal energy E cannot depend on V. In other words, for an ideal gas the 
formula E = E(V, T) reads simply E = E(T). 

We know even more about E(T). Feeding energy to the gas in an isochoric way, i.e. with 
V = const, is possible only by heating: AE = AQ — CV AT. Therefore we find, using the 
empirical fact that Cy = const, that E(T) = C'v T. 

• Thermal interaction — Thermal equilibrium — Temperature 

Bringing two bodies in contact such that they may exchange energy, we will in general 
observe a flow of a certain amount of energy in one direction. As soon as this flow has 
ebbed off, we have reached thermal equilibrium - by definition. 

A measurable quantity to characterize this equilibrium state is the temperature: [T\ = T 2 ] c 

• Second Law 

Not all transformations of energy that are in accordance with the First Law are really 
possible. The Second Law tells us which transformations are excluded. There are several 
logically equivalent formulations: 

Impossible are those processes in which nothing happens but a complete trans- 
formation of AQ into AW. [Kelvin] 

Example: Expansion of a gas against a weighted piston; here we have a complete change 
of AQ into J PdV, but the end state is different from the initial one (larger V). 

Impossible are those processes in which nothing happens but a transport of heat 
AQ from a colder to a warmer reservoir. [Clausius] 

Example: Heat pump; here we do transport AQ, but in order to do so we have to feed in 
mechanical energy. 

• Reversible processes 

If a process is such that the inversion of the arrow of time t — ► —t will again refer to a 
possible process, this process is called reversible. 

It is a consequence of the Second Law that there are processes which are not 
reversible. 

Example 1: Reversible expansion 

Let an ideal gas expand isothermally - i.e. with appropriate input of heat - against a (slowly 
diminishing!) weight. The internal energy of the gas remains constant, {EidG — nCyT), 
and we have 

AQ = AW = J P(V) dV = nRT J i dV = nRT In y (1.2) 

This process may be reversed: by slowly increasing the weight load on the piston and remov- 
ing any excess heat to a thermostatted heat bath we may recompress the gas isothermally, 
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to reach the initial state again. 
Example 2: Irreversible expansion 

Let an ideal gas expand into vacuum (Joule's expansion experiment). Result: T 2 = T\, 
therefore no change of internal energy. In this case no energy has been exerted and stored, 
but the volume has increased. 

Changing the direction of time does not produce a possible process: the shrinking of a gas 
to a smaller volume without input of mechanical energy does not occur. 

• Entropy 

A mathematically powerful formulation of the Second Law relics on a quantity which is 
defined as follows: 

Let 1 — ► 2 be a reversible path from state 1 to 2. The difference of entropies is then 



S has the following important properties: 

o S is a state variable, i.e. in any particular physical state of a system the entropy 
S has a well-defined value, independent of what happened to the system before. This 
value, however, is defined only up to an additive constant; the Third Law removes this 
ambiguity by stating that S(T — > 0) = 0. 

o AS* > Jj 2 dQ/T in all irreversible processes. 

o When a thermally isolated system is in equilibrium the entropy is at its maximum. 

o Thus in a thermally isolated system (the universe being a notable special case) we 
have dQ = and therefore AS > 0, meaning that the entropy will never decrease 
spontaneously. 



given by 




(1.3) 
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o As a consequence of the First Law dE =T dS — P dV we have 

dE 
dS v 



= T 



But this means that we can describe thermal equilibrium in yet another way: 
The flow of energy between two bodies in contact will come to an end when 



dE_ 

dS 



dE 

Is 



(1.4) 



(1.5) 



o If two systems are in thermal equilibrium then S to t = S\ + S2; entropy is additive 
(extensive) . 



• Entropy applied: 

By scrutinizing the entropy balance in a thermodynamic process we may find out whether 
that process is, according to the Second Law, a possible one. In particular, we can easily 
decide whether the change of state is reversible or not. 

Example 1: Reversible expansion 

In the former experiment the entropy of the gas increases by the amount 

AO AW Vo 
AS aas = ^- = -^=nR\n^ (1.6) 

At the same time the heat reservoir delivers the energy AQ to the gas; this decreases the 
reservoir's entropy by 

AS res = -^- = -nRln^- (1.7) 
1 Vi 

Thus the entropy of the combined system remains the same, and the reverse process is 
possible as well. =>reversible. 

Example 2: Irreversible expansion: 

Let the initial and final states of the gas be the same as above. Since S is a state variable 
we have as before 

Yi 

Vi 

This time, however, no energy is fed in, which makes AS res = and thus AStot > 0. 
The reverse process would therefore give rise to a decrease in entropy - which is forbidden: 
==>■ irreversible. 



AS gas =nR\n T f- (1.8) 



• Macroscopic conditions and thermodynamic potentials 

The thermodynamic state - the "macrostate" - of a gas is uniquely determined by two 
independent state variables. Any of the two mechanical variables - P or V - may be 
combined with one of the two thermal variables - T or S - to describe the state. Of course, 
the natural choice will be that pair of variables that is controlled, or monitored, by the 
experimenter. For example, if a sample of gas is contained in a thermostatized (T) cylinder 
with a piston whose position (V) is directly observed, the description in terms of (V, T) is 
indicated. Then again, it may be the force on the piston, and not its position, which we 
measure or control; the natural mechanical variable is then the pressure P. And instead 
of holding the temperature constant we may put a thermal insulation around the system, 
thus conserving its thermal energy or, by = dQ = TdS, its entropy. To describe this 
experimental situation we will of course choose the pair (P, S). Let us consider the possible 
choices: 
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* (S, V): The system's volume and heat content are controlled. This may be done 
by a thermally insulating the sample (while allowing for controlled addition of heat, 
dQ = T dS) and manipulating the position of the piston, i. e. the sample volume V. 
The internal energy is a (often unknown) function of these variables: E — E(S, V). 

Now let the macrostate (S, V) be changed reversibly, meaning that we introduce small 
changes dS, dV of the state variables. According to the First Law, the change dE of in- 
ternal energy must then be the net sum of the mechanical and thermal contributions: 
dE(S,V) = (dE/dS) v dS + (dE/dV) s dV. Comparing this to dE = T dS - P dV 
we derive the thermodynamic ("Maxwell's") relations P = —{dE/dV)s and T = 

{dE/dS)y 

Special case dS = 0: For adiabatic expansion we see that the internal energy of the 
gas changes by AE = — J P dV - just the amount of mechanical work done by the 
gas. 

The internal energy E(S, V) is our first example of a Thermodynamic Potential. 

Its usefulness stems from the fact that the thermodynamic observables P and T may 
be represented as derivatives of E(S,V). We will now consider three more of these 
potentials, each pertaining to another choice of state variables. 

* (V, T): The system's volume and its temperature are controlled. 

The appropriate thermodynamic potential is then the Helmholtz Free Energy de- 
fined by A(V, T) = E- TS. Using dA = dE - T dS - S dT = -P dV - S dT we may 
derive the relations P = -(dA/dV) T and S = -(8A/dT) v . 

Special case dT = 0: Considering a process of isothermal expansion we find that now 
the free energy of the gas changes by AA = — J P dV - again, the amount of mechan- 
ical work done by the gas. 

This is worth remembering: the mechanical work done by a substance (not just an 
ideal gas!) that is allowed to expand isothermally and reversibly from volume V\ to 
V2 is equal to the difference between the free energies of the final and initial states, 
respectively. 

* (T,P): Heat bath and force-controlled piston. 

Gibbs Potential G(P,T) = A + PV: dG = dA + P dV + V dP = -S dT + V dP 

=^S = -{dG/dT) P and V = (dG/dP) T - 

Special case dT = 0: The basic experiment described earlier, isothermal expansion 
against a controlled force (= load on the piston) is best discussed in terms of G: the 
change AG equals simply J x V(P; T = const) dP, which may be either measured or 
calculated using an appropriate equation of state V(P,T). 

* (P, S): As in the first case, the heat content is controlled; but now the force acting on 
the piston (and not the latter's position) is the controllable mechanical parameter. 

Define the Enthalpy H = E + PV: dH = dE + P dV + V dP = T dS + V dP 

=^T = (8H/dS)p and V = (dH/dP) S - 

Special case dS = 0: Again, the system may be allowed to expand, but without 
replacement of the exported mechanical energy by the import of heat (adiabatic ex- 
pansion). The enthalpy difference is then just AH = j 1 V(P;S = const) dP, which 
may be measured. (In rare cases, such as the ideal gas, there may be an equation of 
state for V(P; S = const), which allows us to calculate the integral.) 
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The multitude of thermodynamic potentials may seem bewildering; it should not. As men- 
tioned before, they were actually introduced for convenience of description by the "natural" 
independent variables suggested by the experiment - or by the machine design: we should 
not forget that the early thermodynamicists were out to construct thermomechanical ma- 
chines. 

There is a extremely useful and simple mnemonic scheme, due to Maxwell, that allows us 
to reproduce the basic thermodynamic relations without recourse to longish derivations: 
Maxwell's square. Here it is: 



VAT 




S H P 

Figure 1.1: Thermodynamics in a square: Maxwell's mnemonic device 



• First of all, it tells us that A = A(V, T), E = E(S, V), etc. 

• Second, the relations between the various thermodynamic potentials are barely hidden - 
discover the rules yourself: A = E -TS; H = E + PV; G = A + PV. 

• Next, the eight particularly important Maxwell relations for the state variables V, T, P, S 
may be extracted immediately: 



V = 


dH 

ap 


s 


dG 
~ dP 


T 




(1.9) 


T = 


oh 

~dS 


p 


dE 
~ ~dS 


V 




(1.10) 


P = 


dA 
~ dV 


T 


dE 
dV 


s 


(1.11) 


S = 


dA 
~ df 


V 


dG 
dT 


p 


(1.12) 



Using these relations we may easily write down the description of infinitesimal state changes 
in the various representations given above. To repeat, 

dE(V,S) = -PdV + TdS (1.13) 

dA(V,T) = -PdV-SolT (1.14) 

dG(P,T) = VdP-SdT (1.15) 

dH(P,S) = VdP + TdS (1.16) 



Chemical Potential: So far we have assumed that the mass (or particle) content of the con- 
sidered system was constant. If we allow the number n of moles to vary, another important 
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parameter enters the scene. Generalizing the internal energy change to allow for a substance loss 
or increase, we write 

dE(S,V,n) = -PdV + TdS + fj,dn (1.17) 

In other words, the chemical potential \x quantifies the energy increase of a system upon addition 
of substance, keeping entropy and volume constant: fj, = dE/dn\s,v- Since S is itself dependent 
on n another, equally valid relation is usually preferred: 



dG 
^ dn 



(1.18) 

T,P 



The name given to this state variable stems from the fact that substances tend to undergo a 
chemical reaction whenever the sum of their individual chemical potentials exceeds that of the 
reaction product. However, the importance of fi is not restricted to chemistry. We will encounter 
it several times on our way through statistical/thermal physics. 

That thing called entropy: 

We now set a definite goal for this tutorial. From an analysis of the statistical properties 
of many-body systems we hope to find a microscopic correlate for the quantity which 
thermodynamicists introduced under the name of Entropy. 

Thus we will look out for a function S(E, V) that must have these properties: 
Given two systems (e.g. ideal gases) with m, Vi, E\ and n2, V2, E% = E — E\ which are 
allowed to exchange heat with the constraint that the total energy E remains constant: 



The regular flow of energy in one direction is to stop as soon as 

(equilibrium) 



dS_ 

dE 



dS_ 

dE 



E2 

• The final state shall be characterized by 

S = Si + S 2 (additivity) 

If we succeed in finding such a S(E,V), we can in principle use the inverse function 
E(S, V) and the relations (dE/dV)s = —P etc. to build up thermodynamics from first 
principles! 

1.2 Model systems 

Statistical physics must make use of models. To simplify matters we sometimes invoke crudely 
simplified images of reality, which may seem to render the results of theory useless. However, 
many fundamental statements are all but independent of the particular model system used in 
their derivation. Instead, they are consequences of a few basic properties common to all many- 
body systems, and of the laws of statistics. Thus the following models should be understood 
primarily as vehicles for demonstrating statistical-mechanical predictions. 

• STADIUM BILLIARD 

This model, introduced by Bunimovich and Sinai, will serve us to demonstrate the existence 
of chaos even in quite small systems. Chaos, it must be understood, is a fundamental 
prerequisite for the application of statistical rules. It is a basic property of chaotic systems 
that they will acquire each one of a certain set of "states" with equal probability, i.e. with 
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equal relative frequency. It is this "equal a priory probability" of states which we need to 
proceed into the heart of Statistical Mechanics. 

The stadium billiard is defined as follows. Let a "light ray" or "mass point" move about in a 
two-dimensional container with reflecting or ideally elastic walls. The boundaries have both 
flat and semicircular parts, which gives rise to an efficient mixing of the flight directions 
upon reflection. Such a system is chaotic, meaning that the motional degrees of freedom 
{v x ,v y } exhibit a uniform probability distribution. Since we have v\ + Vy = const the 
"phase points" describing the momentary motion are distributed evenly over the periphery 
of a circle. The model is easily extended into three dimensions; the velocity then has three 
components, energy conservation keeps the phase points on the surface of a sphere, and 
equal a priory probability (or chaos) means that the distribution of points on this "energy 
surface" is homogeneous - nowhere denser or thinner than elsewhere. 

Simulation: Stadium Billiard in 2 Dimensions 




Figure 1.2: Applet Stadium 

- See the trajectory of the particle (ray); note the frequency histograms for flight direction 
4> = arctan(v y /v x ) and x-velocity v x . 

- "Chaos" is demonstrated by simultaneously starting a large number of trajectories with 
nearly identical initial directions: — > fast emergence of equidistribution on the circle v% + 
Vy = const. 

[Code: Stadium] 





Figure 1.3: Applet VarSinai 
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Figure 1.4: Quantum particle in a 2-dimensional box: n x = 3, n y = 2 
Simulation: Sinai Billiard 

- Ideal one particle gas in a box having randomizers on its walls 

- See the trajectory of the particle (ray); note the frequency histograms for flight direction 
<fi = arctan(v y /v x ) and x-velocity v x 

[Code: VarSinai] 

CLASSICAL IDEAL GAS 

N particles are confined to a volume V. There are no mutual interactions between molecules 

- except that they may exchange energy and momentum in some unspecified but conserva- 
tive manner. The theoretical treatment of such a system is particularly simple; nevertheless 
the results are applicable, with some caution, to gases at low densities. Note that air at 
normal conditions may be regarded an almost ideal gas. 

The momentary state of a classical system of N point particles is completely determined by 
the specification of all positions {fi} and velocities {vi}. The energy contained in the sys- 
tem is entirely kinetic, and in an isolated system with ideally clastic walls remains constant. 

IDEAL QUANTUM GAS 

Again, N particles are enclosed in a volume V. However, the various states of the system 
arc now to be specified not by the positions and velocities but according to the rules of 
quantum mechanics. Considering first a single particle in a one-dimensional box of length 
L. The solutions of Schroedingcr's equation 



HV(x) = EV(x) with H = - 




(1.19) 



are in this case \& n (ar) = (l/\/L) sin(27rnx/L), with the energy eigenvalues E n = h 2 n 2 /8mL 2 
(n = l,2,...). 



In two dimensions - the box being quadratic with side length L - we have for the energies 

E * = ^(< +n l) ( L2 °) 
where n = {n x ,n y }. A similar expression may be found for three dimensions. 
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If there are N particles in the box we have, in three dimensions, 



i=l 

where rii x is the x quantum number of particle i. 

Note: In writing the sum 1.21 we only assumed that each of the TV particles is in a certain 
State Tli = (u^, W>iy , Tl{z ). We have not considered yet if any combination of single particle 
states fii (i = 1, . . . , N) is indeed permitted, or if certain fii, rlj might exclude each other 
(Pauli priciple for fcrmions.) 



• HARD SPHERES, HARD DISCS 

Again we assume that N such particles are confined to a volume V. However, the finite-size 
objects may now collide with each other, and at each encounter will exchange energy and 
momentum according to the laws of elastic collisions. A particle bouncing back from a wall 
will only invert the respective velocity component. 

At very low densities such a model system will of course resemble a classical ideal gas. 
However, since there is now a - albeit simplified - mechanism for the transfer of momentum 
and energy the model is a suitable reference system for kinetic theory which is concerned 
with the transport of mechanical quantities. The relevant results will be applicable as first 
approximations also to moderately dense gases and fluids. 

In addition, the HS model has a special significance for the simulation of fluids. 
Simulation: Hard discs 

- "Gas" of hards discs in a square box with reflecting walls. To achieve chaos 
even with a single moving particle the walls are decorated with "randomizers" , i.e. 
reflecting semicircles. 

The motion of 1, 2, . . . N particles is followed. [Code: Harddisks] 

- Displayed: trajectory; frequency histograms for flight direction <j> = arctan(v y /v x ) 
and x-speed v x . 

[Code: Harddisks] 
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Figure 1.5: Applet Harddisks 
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Simulation: Hard spheres 

- "Gas" of N hard spheres in a cubic box with reflecting walls. To achieve chaos 
even with a single moving particle the walls are decorated with "randomizers" , i.e. 
reflecting semispheres. 

The motion of 1, 2, ... N particles is followed. 

- Displayed: trajectory; frequency histograms for flight direction <j> = arctan(v y /v x ) 
and x-speed v x . 

[Code: Hspheres] 





■ 




* 


• • 

.f' 





L jSP J 



ikiiii i i n~ 
i 1 



i Cauulgr ■"■I'H ><« 



Figure 1.6: Applet Hspheres 



=£> Simulation 1.4: ./V hard discs in a 2D box with periodic boundaries. [Code: 
Hdiskspbc, UNDER CONSTRUCTION] 



• LENNARD-JONES MOLECULES 

This model fluid is defined by the interaction potential (see figure) 

U(r) = 4e[(r/a)- 12 - (r/a)- 6 } (1.22) 

where e (potential well depth) and a (contact distance) are substance specific parameters. 

In place of the hard collisions we have now a continuous repulsive interaction at small 
distances; in addition there is a weak attractive force at intermediate pair distances. The 
model is fairly realistic; the interaction between two rare gas atoms is well approximated 
by equ. 1.22. 

The LJ model achieved great importance in the Sixties and Seventies, when the micro- 
scopic structure and dynamics of simple fluids was an all-important topic. The interplay of 
experiment, theory and simulation proved immensely fruitful for laying the foundations of 
modern liquid state physics. 

In simulation one often uses the so-called "periodic boundary conditions" instead of reflect- 
ing vessel walls: a particle leaving the (quadratic, cubic, ...) cell on the right is then fed in 
with identical velocity from the left boundary, etc. This guarantees that particle number, 
energy and total momentum are conserved, and that each particle is at all times surrounded 
by other particles instead of having a wall nearby. The situation of a molecule well within 
a macroscopic sample is better approximated in this way. 

Simulation: Lennard-Jones fluid 

iV Lennard-Jones particles in in a 2d box with periodic boundary conditions. 
[Code: L Jones] 
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Figure 1.7: Lennard- Jones potential with e = 1 (well depth) and a — 1 (contact distance where 
U(r) = 0). Many real fluids consisting of atoms or almost isotropic molecules are well described 
by the LJ potential. 
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Figure 1.8: Applet LJones 



HARMONIC CRYSTAL 

The basic model for a solid is a regular configuration of atoms or ions that are bound 
to their nearest neighbors by a suitably modelled pair potential. Whatever the functional 
form of this potential, it may be approximated, for small excursions of any one particle from 
its equilibrium position, by a harmonic potential. Let / denote the equilibrium (minimal 
potential) distance between two neighbouring particles; the equilibrium position of atom j 
in a one-dimensional lattice is then given by Xj = jl. Defining the displacements of the 
atoms from their lattice points by Xj we have for the energy of the lattice 



/ N m N 

E(x,x) = -^(i, - Xj-xf + — ^2± 2 j 

where / is a force constant and m is the atomic mass. 

The generalization of 1.23 to 2 and 3 dimensions is straightforward. 



(1.23) 
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The further treatment of this model is simplified by the approximate assumption that each 
particle is moving independently from all others in its own oscillator potential: E(x, x) 
w / Y]j— i Xj +(m/2) Y]j—i Xj. In going to 2 and 3 dimensions one introduces the further 
simplifying assumption that this private oscillator potential is isotropically "smeared out" : 
E P ot{{x, y, z}) s=a + Vj + z j)- The model thus defined is known as the "Einstein 

model" of solids. 



• MODELS FOR COMPLEX MOLECULES 

Most real substances consist of more complex units than isotropic atoms or Lennard- Jones 
type particles. There may be several interaction centers per particle, containing electrical 
charges, dipoles or multipoles, and the units may be joined by rigid or flexible bonds. Some 
of these models are still amenable to a theoretical treatment, but more often than not the 
methods of numerical simulation - Monte Carlo or molecular dynamics - must be invoked. 



• SPIN LATTICES 

Magnetically or electrically polarizable solids are often described by models in which "spins" 
with the discrete permitted values Ui = ±1 are located at the vertices of a lattice. 

If the spins have no mutual interaction the discrete states of such a system are easy to 
enumerate. This is why such models are often used to demonstrate of statistical-mechanical 
- or actually, combinatorical - relations (Reif: Berkeley Lectures). The energy of the system 
is then defined by E = —H^- o~i, where H is an external field. 

Of more physical significance are those models in which the spins interact with each other, 
For example, the parallel alignment of two neighboring spins may be energetically favored 
over the antiparallcl configuration (Ising model). Monte Carlo simulation experiments 
on systems of this type have contributed much to our understanding of the properties of 
ferromagnetic and -electric substances. 

1.3 Fundamentals of Statistics 

By statistics we denote the investigation of regularities in apparently non-deterministic processes. 
An important basic quantity in this context is the "relative frequency" of an "event" . Let us 
consider a repeatable experiment - say, the throwing of a die - which in each instance leads to 
one of several possible results e - say, e = numberof points = 4. Now repeat this experiment 
n times under equal conditions and register the number of cases in which the specific result e 
occurs; call this number / n (e). The relative frequency of e is then defined as r(e) = f n {e)/n. 

Following R. von Mises we denote as the "probability " of an event e the expected value of 
the relative frequency in the limit of infinitely many experiments: 

V(e) = lim (1.24) 

n^oo n 

Example: Game die; 100-1000 trials; e = {no. of points = 6}, or e = {no. of points 
<3}. 

Now, this definition does not seem very helpful. It implies that we have already done some 
experiments to determine the relative frequency, and it tells us no more than that we should 
expect more or less the same relative frequencies when we go on repeating the trials. What we 
want, however, is a recipe for the prediction of V(e). 
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To obtain such a recipe we have to reduce the event e to so-called "elementary events" e that 
obey the postulate of equal a priori probability. Since the probability of any particular one 
among K possible elementary events is just V(ei) = 1/K, we may then derive the probability of 
a compound event by applying the rules 

V(e = e i ore j ) = V{€ t )+V{€ 3 ) (1.25) 
V(e = e, and £j ) = V(e l ) ■ V{e ) (1.26) 

Thus the predictive calculation of probabilities reduces to the counting of the possible elementary 
events that make up the event in question. 

Example: The result e§ = {no. of points = 6} is one among 6 mutually exclusive 
elementary events with equal a priory probabilities (= 1/6). The compound event e = 
{no. of points < 3} consists of the elementary events ej = {1,2 or 3}; its probability 
is thus V{1 V 2 V 3) = 1/6 + 1/6 + 1/6 = 1/2. 



How might this apply to statistical mechanics? 
mechanical systems with possible states s\, s 2 , ■ ■ 
probability of a situation in which 



- Let us assume that we have N equivalent 
Sk- A relevant question is then: what is the 

k 2 systems in state S2, etc.} (1-27) 



e = {hi systems are in state S\, 



Example: N — 60 dice are thrown (or one die 60 times!). What is the probability that 
10 dice each have numbers of points 1,2,... 6? What, in contrast, is the probability 
that all dice show a "one"? 

The same example, but with more obviously physical content: 

Let N — 60 gas atoms be contained in a volume V, which we imagine to be divided 
into 6 equal partial volumes. What is the probability that at any given time we find 
ki = 10 particles in each subvolume? And how probable is the particle distribution 
(60,0,0,0,0,0)? (Answer: see below under the heading "multinomial distribution".) 

We can generally assume that both the number N of systems and the number K of accessible 
states are very large - in the so-called "thermodynamic limit" they are actually taken to approach 
infinity. This gives rise to certain mathematical simplifications. 

Before advancing into the field of physical applications we will review the fundamental con- 
cepts and truths of statistics and probability theory, focussing on events that take place in number 
space, either 1Z (real numbers) or Af (natural numbers). 

DISTRIBUTION FUNCTION 

Let x be a real random variate in the region (a, b). The distribution function 

P(x ) = V{x < x } (1.28) 

is defined as the probability that some x is smaller than the given value x . The function 
P(x) is monotonically increasing and has P(a) = and P(b) = 1. The distribution function is 
dimensionless: [P(x)] = 1. 

The most simple example is the equidistribution for which 

P(xo) = (1-29) 
b - a 
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Another important example, with a = — oo, b = oo, is the normal distribution 

P(x ) = -7= / dxe^ ' 2 (1.30) 

V27T J_oc 

and its generalization, the Gaussian distribution 

P(x ) = ^= dxe- {x -^' 2a2 (1.31) 

V27T(T 2 J-oc 

where the parameters (x) and c 2 define an ensemble of functions. 
DISTRIBUTION DENSITY 

The distribution or probability density p(x) is defined by 

p{xo) dx = V{x e [xo, xo + dx}} = dP(xo) (1-32) 
In other words, p(x) is just the differential quotient of the distribution function: 

p ^ = dPjx)_^ i.e. P( Xo ) = r° p{x) dx (1.33) 
p(x) has a dimension; it is the reciprocal of the dimension of its argument x: 

\p(x)} = -L (1.34) 

For the equidistribution we have 

p(x) = l/(b-a), (1.35) 

and for the normal distribution 

p(x) = J=e-* 2 /2. (L36) 



If x is limited to discrete values x a with a step Ax a = x a+ i — x a one often writes 

p a =p(x a )Ax a (1-37) 

for the probability of the event x = x a . This p a is by definition dimensionless, although it is 
related to the distribution density p(x) for continuous arguments. The definition 1.37 includes 
the special case that x is restricted to integer values k; in that case Ax Q = 1. 

MOMENTS OF A DENSITY 

By this we denote the quantities 

(x n ) = / x n p(x)dx or, in the discrete case, = ^p Q x™ (1.38) 

J a a 

The first moment (x) is also called the expectation value or mean value of the distribution 
density p(x), and the second moment (x 2 ) is related to the variance and the standard devi- 
ation: variance a 2 = (x 2 ) — (x) 2 (standard deviation a = square root of variance). 



Examples: 



.) For an equidistribution e[0, 1] we have (x) = 1/2, (x 2 ) = 1/3 and a 2 = 1/12. 
.) For the normal distribution we find (x) = and (x 2 ) = a 2 = 1. 
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Figure 1.9: Equidistribution and normal distribution functions P and densities p 



SOME IMPORTANT DISTRIBUTIONS 

• Equidistribution: Its great significance stems from the fact that this distribution is central 
both to statistical mechanics and to practical numerics. In the theory of statistical-mechanical 
systems, one of the fundamental assumptions is that all states of a system that have the same 
energy are equally probable (axiom of equal a priori probability). And in numerical computing 
the generation of homogeneously distributed pseudo-random numbers is relatively easy; to ob- 
tain differently distributed random variates one usually "processes" such primary equidistributed 
numbers. 

• Gauss distribution: This distribution pops up everywhere in the quantifying sciences. The 
reason for its ubiquity is the "central value theorem": Every random variate that can be ex- 
pressed as a sum of arbitrarily distributed random variates will in the limit of many summation 
terms be Gauss distributed. For example, when we have a complex measuring procedure in which 
a number of individual errors (or uncertainties) add up to a total error, then this error will be 
nearly Gauss distributed, regardless of how the individual contributions may be distributed. In 
addition, several other physically relevant distributions, such as the binomial and multinomial 
densities (see below), approach the Gauss distribution under certain - quite common - circum- 
stances. 

• Binomial distribution: This discrete distribution describes the probability that in n inde- 
pendent trials an event that has a single trial probability p will occur exactly k times: 

Pk = ~P{k times e in n trials} 

= Qp fc (l-p) n - fc (1.39) 

For the first two moments of the binomial distribution we have (k) = np (not necessarily integer) 
and a 2 = np{\ - p) (i.e. (k 2 ) - (k) 2 ). 



Application: Fluctuation processes in statistical systems arc often described in 
terms of of the binomial distribution. For example, consider a particle freely roaming 
a volume V. The probability to find it at some given time in a certain partial volume 
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Figure 1.10: Binomial distribution density pjj 

Vi is p(Vi) — Vi/V. Considering now N independent particles in V, the probability 
of finding just N\ of them in V\ is given by 



N 



{V l /V) Nl {\-V x /V) N - Nl 



The average number of particles in V\ and its standard deviation are 



(iVi) = NVx/V and a = ^/(AN^ 2 = ^N(Vi/V){l - V[/V). 



(1.40) 



(1.41) 



Note that for Np w 1 we have for the variance <T 2 ~ff~ (N\) m 1, meaning that the 
population fluctuations in V\ are then of the same order of magnitude (namely, 1) as 
the mean number of particles itself. 



For large n such that np » 1 the binomial distribution approaches a Gauss distribution 

with mean np and variance a 2 = npq (theorem of Moivre-Laplace): 



Pk^Pc(k) 



^/2impq 



exp [— (fc — np) 2 /2npq] 



(1.42) 



with q = 1 — p. 
If n — > oo and p 



such that their product np = A remains finite, the density 1.39 approaches 

(1.43) 



Pn(k) - x 



which goes by the name of Poisson distribution. 

An important element in the success story of statistical mechanics is the fact that with 
increasing n the sharpness of the distribution 1.39 or 1.42 becomes very large. The relative 
width of the maximum, i. e. cr/{k), decreases as 1/y/n. For n = 10 4 the width of the peak is 
no more than 1% of (fc), and for "molar" orders of particle numbers n « 10 24 the relative width 
<y/(k) is already ~ 10~ 12 . Thus the density approaches a "delta distribution". This, however, 
renders the calculation of averages particularly simple: 



(1.44) 
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or 

(/(fc)) » / <&<*(* - = /((fc» (1-45) 

• Multinomial distribution: This is a generalization of the binomial distribution to more than 
2 possible results of a single trial. Let e\, e 2 , ■ ■ ■ , e-K be the (mutally exclusive) possible results 
of an experiment; their probabilities in a single trial are pi,p 2 , ■ ■ ■ ,Pk, with Y^f Pi = 1- Now do 
the experiment n times; then 

nl 

p n {k 1 ,k 2 ,...,k K ) = - — . p^p* 2 ■■■P k K K {with k 1 + k 2 + ... + k K =n) (1.46) 

K\\K 2 - ■ ■ ■ KK- 

is the probability to have the event e\ just ki times, e 2 accordingly k 2 times, etc. 

We get an idea of the significance of this distribution in statistical physics if we interpret the 
the K possible events as "states" that may be taken on by the n particles of a system (or, in 
another context, by the n systems in an ensemble of many-particle systems). The above formula 
then tells us the probability to find k\ among the n particles in state e\, etc. 



Example: A die is cast 60 times. The probability to find each number of points just 
10 times is 

60! / 1 \ ^ 

P6o(10, 10, 10, 10, 10, 10) = ^-J = 7.457 • HT 5 . (1.47) 

To compare, the probabilities of two other cases: p§o(10, 10,10,10,9,11) = 6.778 • 
10~ 5 , P6o(15, 15, 15, 5, 5, 5) = 4.406- 10~ 8 . Finally, for the quite improbable case 
(60, 0, 0, 0, 0, 0) we have p 6a = 2.046 • 10~ 47 

Due to its large number of variables (K) we cannot give a graph of the multinomial distribu- 
tion. However, it is easy to derive the following two important properties: 

Approach to a multivariate Gauss distribution: just as the binomial distribution ap- 
proaches, for large n, a Gauss distribution, the multinomial density approaches an appropriately 
generalized - "multivariate" - Gauss distribution. 

Increasing sharpness: if n and k\ . . . kx become very large (multiparticle systems; or ensem- 
bles of n — > oo elements), the function p n (k\, k 2 , ■ ■ ■ , km) = Pn(k) has an extremely sharp 
maximum for a certain partitioning k* = {&*, k%, . . . , fc^}, namely {k* = npf, i = 1, . . . ,K}. 
This particular partitioning of the particles to the various possible states is then "almost always" 
realized, and all other allotments (or distributions) occur very rarely and may safely be neglected. 

This is the basis of the method of the most probable distribution which is used with 
great success in several areas of statistical physics. [2.2] 

STIRLING'S FORMULA 

For large values of m the evaluation of the factorial ml is difficult. A handy approximation is 
Stirling's formula 

ml w V2ttto (m/e) m (1.48) 

Example: m = 69 (Near most pocket calculators' limit): 69! = 1.7112 • 10 98 ; 
V2tt • 69 (69/e) 69 = 1.70 92 • 10 98 . 

The same name Stirling's formula is often used for the logarithm of the factorial: 

In ml w m(ln m — 1) + In \j2ixm w m(ln m — 1) (1.49) 
(The term In \j2-nm may usually be neglected in comparison to m(ln m — 1).) 
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Example 1: In 69! = 226.1905; 69(ln 69 - 1) + In V2tt • 69 = 223.1533 + 3.0360 = 
226.1893. 



Example 2: The die is cast again, but now there are 120 trials. When asked to 
produce 120! most pocket calculators will cancel their cooperation. So we apply 
Stirling's approximation: 

The probability of throwing each number of points just 20 times is 

6 

= 1.350 -lO" 5 , (1.50) 
and the probability of the partitioning (20, 20, 20, 20, 19, 21) is 1.285 • 10" 5 . 



Pi2o(20,...,20) = 



120! 
(20!) 6 



120 



V240tt 



120 \ 20 1 
"67 J 20! 



STATISTICAL (IN) DEPENDENCE 

Two random variates X\,X2 are statistically mutually independent (uncorrelated) if the distri- 
bution density of the compound probability (i.e. the probability for the joint occurence of x\ 
and x 2 ) equals the product of the individual densities: 

p{x\,x 2 ) = p{x\)p(x 2 ) ■ (1.51) 

Example: In a fluid or gas the distribution density for a single component of the 
particle velocity is given by (Maxwell-Boltzmann) 



i jjj 7TIV 

pM = V^ exp{ "^ } ' a = w (L52) 

The degrees of freedom a — x,y,z are statistically independent; therefore the com- 
pound probability is given by 

p(v) =p(v x ,v y ,v z ) =p{v x )p{v y )p{v z ) = (t^tJ e *P{-7^f( v l+ v l+v 2 z )} (1-53) 

By conditional distribution density we denote the quantity 

p(x 1 ,x 2 ) . . 

p(X2|xi) = ^T ( } 

(For uncorrelated Xi,x 2 we have p(x 2 \xi) = p(x 2 ))- 

The density of a marginal distribution describes the density of one of the variables regard- 
less of the specific value of the other one, meaning that we integrate the joint density over all 
possible values of the second variable: 

rbx 

p(x 2 ) = / p(x 1 ,x 2 )dx 1 (1.55) 

J a± 



TRANSFORMATION OF DISTRIBUTION DENSITIES 

From 1.32 we can immediately conclude how the density p(x) will transform if we substitute the 
variable x. Given some bijective mapping y = f(x); x = f^ 1 {y) the conservation of probability 
requires 

\dP(y)\ = \dP(x)\ (1.56) 
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Figure 1.11: Transformation of the distribution density (see Example 1) 



(The absolute value appears because we have not required f(x) to be an increasing function.) 
This leads to 

\p(y)dy\ = \p(x)dx\ (1.57) 



or 



p(y) =p{x) 



dx 
dy 



= p[f-\y)\ 



df-\y) 



dy 



(1.58) 



Incidentally, this relation is true for any kind of density, such as mass or spectral densities, and 
not only for distribution densities. 

Example 1: A particle of mass m moving in one dimension is assumed to have any 
velocity in the range ±w with equal probability; so we have p(v) — l/2v . The 
distribution density for the kinetic energy is then given by (see Figure 1.11) 



p{E) = 2p(v) 



dv 



dE 



1 



1 



(1.59) 



in the limits O..E , where E = mv 2 /2. (The factor 2 in front of p(v) comes from the 
ambiguity of the mapping v <-> E) . 



Example 2: An object is found with equal probability at any point along a circular 
periphery; so we have p(4>) — 1/2tt for <jye [0, 2tt]. Introducing cartesian coordinates 
x = r cos (j), y — r sin <f> we find for the distribution density of the coordinate x, with 
x e [±r] , that 

11 



p(x) =p{4>) 



dx 



71" vV 2 — X 2 



(1.60) 



(see Figure 1.12) 



Problems equivalent to these examples: 

a) A homogeneously blackened glass cylinder - or a semitransparent drinking straw 
- held sideways against a light source: absorption as a function of the distance from 
the axis? 

b) Distribution of the x-velocity of a particle that can move randomly in two dimen- 
sion, keeping its kinetic energy constant. 
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Figure 1.12: Transformation of the distribution density (see Example 2) 



=^ Simulation 1.6: Stadium Billiard. Distribution of the velocity component 
V x . [Code: Stadium] 

c) Distribution of the velocity of any of two particles arbitrarily moving in one di- 
mension, keeping only the sum of their kinetic energies constant. 



For the joint probability density of several variables the transformation formula is a direct 
generalization of 1.58, viz. 

p(y) =P{x) 



dij 



(1.61) 



Here we write \dx/dy\ for the functional determinant (or Jacobian) of the mapping x = x(y), 



\d(x 1 ,x 2 ,...)/d(y 1 ,y 2 ,...)\ = 



dxi/dyi dx\/dy2 
dx2/dyi dx 2 /dy 2 



(1.62) 



Example 3: Again, let v = {v x ,v y ,v z }, and p(v) as in cqu. 1.53. Now we write w 
= {v, (j), 9}, with 



v. x = v sin v cos 0, v y — v sin sin <p, v z — v cos . 
The Jacobian of the mapping v = v(w) is 



(1.63) 



\d(v x ,v y ,v z )/d(v,<f>,0)\ = 



sine; cos <p — vsmasmcp v cost; cos < 
sin 9 sin v sin 9 cos 4> v cos 9 sin c 
cos 9 — vsin9 



= —v smt 



(1.64) 



Therefore we have for the density of the modulus of the particle velocity 

/•2-7T fK 



p(v) 







*' 2s '°"(sif) 3,2 "»f-sf" 2 ' < L65 > 



/ m \ 3 / 2 2 , m o 
4?r - ; — w cxp^ — — — -v \ 
\2TTkTJ ^ l 2fcT J 



(1.66) 
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1.4 Problems for Chapter 1 



EXERCISES: 

1.1 Entropy and irreversibility: (a) Two heat reservoirs are at temperatures T\ and T 2 > T\. 

They are connected by a metal rod that conducts the heat Q per unit time from 2 to 1. Do an 
entropy balance to show that this process is irreversible. 

(b) Using the specific values Ti = 300K, T 2 — 320K and Q = 10 J, calculate the entropy increase 
per second. 

1.2 Reversible, isothermal expansion: Compute the entropy balance for the experiment 
described (or shown) in the lecture, using estimated values of the necessary experimental param- 
eters. 

Discuss the role of the ideal gas assumption: is it necessary / unnecessary / convenient ? 

1.3 Maxwell square: 

Draw up Maxwell's square and use it to complete the following equations: 
(a) G = A±...; (b) A = E ± . . 

(c) P = ... = .. . (in terms of derivatives of A and E); 

(d) dG = V dP - .... 

1.4 Random directions in 2D: Using your favourite random number generator, sample a 
number K m 50 — 100 of angles fa (i = 1, . . . , K) equidistributed in [0, 2tt\. Interpret cos<^ and 
sinfa as the v x , y — components of a randomly oriented velocity vector Vi with \vi\ = 1. 

(a) Draw a histogram of the empirical probability (i.e. event frequency) of p{v x ). Compare the 
shape of your p(v x ) to the bottom right histogram in Applet Stadium (see 1.2). 

(b) Normalize the histogram such that a sum over all bins equals one. What is the value of 
p(0.5)? 

1.5 Binomial distribution: Suggest an experiment with given p and n. Perform the experi- 
ment N times and draw an empirical frequency diagram; compare with 1.39. 

1.6 Density fluctuations in air: 

(a) Calculate the mean number of molecules (not discerning between N 2 and 2 ) that are to be 
found at a pressure of 10 Pa in a cube with a side length of the wave length of light (rs 6 • 10~ 7 m). 
What is the standard deviation of the particle number, both absolutely and relative to the mean 
particle number? (Air is to be treated as an ideal gas at normal temperature T = 273.15 K.) 

(b) Compute the value of the probability density of the event N(AV) = k N >, i. e. the 
probability of finding an integer number k next to the mean number of particles in the sample 
volume? (Hint: Don't attempt to evaluate factorials of large numbers, such as appear in the bi- 
nomial distribution rather, use that distribution which resembles p^ when n becomes large.) 
What is the probability of finding only 95 percent of the mean particle number in the sample 
volume? 

1.7 Multinomial distribution: A volume V is divided into m — 5 equal-sized cells. The 
TV = 1000 particles of an ideal gas may be allotted randomly to the cells. 

a) What is the probability of finding in a snapshot of the system the partitioning {Ni,N 2 , ■ . . , N 5 }7 
Explain the formula. 

b) Demonstrate numerically that the partitioning with the greatest probability is given by 
Ni = N/m = 200. For example, compare the situations (201,199,...), (202,199,199,...), 
(202, 198, . . .), (205, 195, . . .), and (204, 199, 199, 199, 199) to the most probable one. 

c) (1 bonus point) Prove analytically that Ni = 200 is the most probable distribution. Hint: 
minimize the function f(k) = log p n (k) under the condition J2i = n - 

1.8 Transformation of a distribution density: Repeat the calculation of Example 3 for the 
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two-dimensional case, i.e. v = {v x ,v y } and w = {v, <f)}. Draw the distribution density P2d{v)- 
TEST YOUR UNDERSTANDING OF CHAPTER 1: 

1.1 Thermodynamic concepts: 

- What does the entropy balance tell us about the reversibility /irreversibility of a process? 
Demonstrate, using a specific example. 

- Describe the process of thermal interaction between two bodies. When will the energy flow 
stop? 

- Which thermodynamic potential is suited for the description of isothermal-isochoric systems? 

1.2 Model systems: 

- Describe 2-3 model systems of statistical mechanics. 

- What quantities are needed to completely describe the momentary state of a classical ideal gas 
of N particles? 

- What quantities are needed for a complete specification of the state of a quantum ideal gas? 

1.3 Statistical concepts: 

- Explain the concepts "distribution function" and "distribution density"; give two examples. 

- What are the moments of a distribution? Give a physically relevant example. 

1.4 Equal a priori probability: Explain the concept and its significance for statistical me- 
chanics. 
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Chapter 2 

Elements of Kinetic Theory 




Figure 2.1: Ludwig Boltzmann 



In a dilute gas the molecules are in free, linear flight most of the time; just occasionally their 
flight will be interrupted by a collision with a single other particle. The result of such an event, 
which in general may be treated as a classical elastic collision, is a change in the speeds and 
directions of both partners. So it should be possible to derive, from a statistical treatment of 
such binary collisions, predictions on the properties of gases. This idea was the starting point 
from which Ludwig Boltzmann proceeded to develop his "Kinetic Theory of Gases" . 

First he defined a distribution density / such that / (r, v; t) dfdv denotes the number of 
particles which at time t situated at r and have a velocity v. The 6-dimensional space of the 
variables {r, v} has later been called "/i space". 1 

The evolution in time of the function / (r, v; t) is then described by Boltzmann's Transport 
Equation. We will shortly sketch the derivation and shape of this important formula. 

A particularly important result of Boltzmann's equation is its stationary solution, i.e. the 
function that solves the equation in the long-time limit t — > oo. It turns out that this equilibrium 

lr The term is probably due to Paul Ehrenfest who in his classical book on Statistical Mechanics refers to /i-space, 
or "molecular" space as opposed to T, or "gas" space (see Chapter 3 below). 
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distribution in /i space may be derived without explicitely solving the transport equation itself. 
The strategy used to do so, called the method of the most probable distribution, will be 
encountered again in other parts of Statistical Mechanics. 



2.1 Boltzmann's Transport Equation 

With his "Kinetic Theory of Gases" Boltzmann undertook to explain the properties of dilute 
gases by analysing the elementary collision processes between pairs of molecules. 

The evolution of the distribution density in fi space, / (r, v; t), is described by Boltzmann's 
transport equation. A thorough treatment of this beautiful achievement is beyond the scope 
of our discussion. But we may sketch the basic ideas used in its derivation. 

• If there were no collisions at all, the swarm of particles in \x space would flow according to 

f ^r + vdt,v+^dt;t + dtj =f(f,v;t) (2.1) 

where K denotes an eventual external force acting on particles at point (r, v) . The time 
derivative of / is therefore, in the collisionless case, 

(m + Vr + ^ ' v *) m * t] = (2 ' 2) 

where 

v .V f f = v x -+v y -+v z - (2.3) 

and 

lit 1 1 L Y Ugr; \J Uy KJ U % J 

To gather the meaning of equation 2.2 for free flow, consider the collisionless, free flow of 
gas particles through a thin pipe: there is no force (i. e. no change of velocities), and 
/x-space has only two dimensions, x and v x (see Figure 2.2). 
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Figure 2.2: A very simple /x-space 
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At time t a differential "volume element" at (x,v x ) contains, on the average, f(x,v x )dxdv x 
particles. The temporal change of f(x,v x ) is then given by 

df(x,v x ) _ df(x,v x ) 

dt ~ ~ Vx dx {2 - b > 

To see this, count the particles entering during the time span dt from the left (assuming v x > 
0, n in = f(x — v x dt,v x )dx dv x and those leaving towards the right, n out = f(x,v x )dxdv x . 
The local change per unit time is then 

df(x,v x ) 



dt dt dx dv x 

f(x - v x dt,v x ) - f(x,v x ) 
~ dt 

f{x,v x ) - (v x dt) (df/dx) - f(x,v x 
~ dt 



(2.6) 

(2.7) 
(2.8) 
(2.9) 
(2.10) 

= -"-^r 2 ^ 

The relation ^ + v x = is then easily generalized to the case of a non- vanishing force, 

df df K x df n /n n . 

-4 + ^7r + — 7r L = ( 2 - 12 ) 

dt dx m dv x 

(this would engender an additional vertical flow in the figure), and to six instead of two 
dimensions (see equ. 2.2). 

All this is for collisionless flow only. 

In order to account for collisions a term (df /dt) co udt is added on the right hand side: 

(l + '- v ' + s- v ')««"-(sL <2 ' 13 > 

The essential step then is to find an explicit expression for (df /dt) co u. Boltzmann solved 
this problem under the simplifying assumptions that 

- only binary collisions need be considered (dilute gas); 

- the influence of container walls may be neglected; 

- the influence of the external force K (if any) on the rate of collisions is negligible; 

- velocity and position of a molecule are uncorrelated (assumption of molecular chaos) . 

The effect of the binary collisions is expressed in terms of a "differential scattering cross 
section" a(Q) which describes the probability density for a certain change of velocities, 

{t7i,tfe}-»{t/i,t/ 2 }- (2-14) 

(fi thus denotes the relative orientation of the vectors (v 2 — v x ) and (v2 — The function 
cr(fi) depends on the intermolecular potential and may be either calculated or measured. 



Under all these assumptions, and by a linear expansion of the left hand side of equ. 2.1 with 
respect to time, the Boltzmann equation takes on the following form: 

■ V ? + ^ • V* )fi = Jdnj dv 2 CT (0) |«! - v 2 \ [f[f' 2 - M 2 ) (2.15) 
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where f\ = f(f,vi;t), f 1 = f{r 1 v l \t) etc. This integrodifferential equation describes, under the 
given assumptions, the spatio-temporal behaviour of a dilute gas. Given some initial density 
f(f,v;t = 0) in /i-space the solution function f(f,v;t) tells us how this density changes over 
time. Since / has up to six arguments it is difficult to visualize; but there are certain moments 
of / which represent measurable averages such as the local particle density in 3D space, whose 
temporal change can thus be computed. 

Chapman and Enskog developed a general procedure for the approximate solution of Boltz- 
mann's equation. For certain simple model systems such as hard spheres their method produces 
predictions for f(r,v;t) (or its moments) which may be tested in computer simulations. An- 
other more modern approach to the numerical solution of the transport equation is the "Lattice 
Boltzmann" method in which the continuous variables f and v are restricted to a set of discrete 
values; the time change of these values is then described by a modified transport equation which 
lends itself to fast computation. 

The initial distribution density f(f,v;0) may be of arbitrary shape. To consider a simple 
example, we may have all molecules assembled in the left half of a container - think of a removable 
shutter - and at time t = make the rest of the volume accessible to the gas particles: 

f(f,v,0) = AQ(x -x)f (v) (2.16) 

where fo(v) is the (Maxwell-Boltzmann) distribution density of particle velocities, and 0(xq — x) 
denotes the Heaviside function. The subsequent expansion of the gas into the entire accessible 
volume, and thus the approach to the stationary final state (= equilibrium state) in which the 
particles are evenly distributed over the volume may be seen in the solution f(r,v;t) of Boltz- 
mann's equation. Thus the greatest importance of this equation is its ability to describe also 
non-equilibrium processes. 

Simulation: The power of Boltzmann's equation 

- Irreversible Expansion of a hard disc gas 

- Presentation of the distribution densities in r-space and in v-space 
[Code: BM] 
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The Equilibrium distribution fo(f,v) is that solution of Boltzmann's equation which is sta- 
tionary, meaning that 

dnw! = 

dt x ' 

It is also the limiting distribution for long times, t — > oo. 

It may be shown that this equilibrium distribution is given by 



fo(f,v) = p{r) 



27rfcT(f) 



3/2 



exp{— m [v — Vo(r)] /2kT(r)} 



(2.18) 
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where p{r) and T(f) are the local density and temperature, respectively. 

If there are no external forces such as gravity or electrostatic interactions we have p{r) = po = 
N/V. In case the temperature is also independent of position, and if the gas as a whole is not 
moving (v Q = 0), then f(f,v) = pofo(v), with 

Lzirkl J 

This is the famous Boltzmann distribution; it may be derived also in different ways, without 
requiring the explicit solution of the transport equation. =>See next section, equ.2.30. 

2.2 The Maxwell-Boltzmann distribution 

We want to apply statistical procedures to the swarm of points in Boltzmann's p space. To do 
this we first divide that space in 6-dimensional cells of size (Ax) 3 (Aw) 3 , labelling them by j 
(= 1, . . . , to). There is a characteristic energy Ej = E(fj,Vj) pertaining to each such cell. For 
instance, in the ideal gas case this energy is simply Ej — touJ/2, where Vj is the velocity of the 
particles in cell j. 

Now we distribute the N particles over the m cells, such that rij particles are allotted to 
cell no. j. In a closed system with total energy E the population numbers rij must fulfill the 
condition J2j n jEj — E. The other condition is, of course, the conservation of the number of 
particles, • rij = N. Apart from these two requirements the allottment of particles to cells is 
completely random. 

We may understand this prescription as the rule of a game of fortune, and with the aid of a 
computer we may actually play that game! 

Playing Boltzmann's game 
[Code: LBRoulette] 




Instead of playing the game we may calculate its outcome by probability theory. For good 
statistics we require that N » m » 1. A specific m-tuple of population numbers ft = {n^; j = 
1, . . . , m) will here be called a partitioning. (If you prefer to follow the literature, you may 
refer to it as a distribution.) Each partitioning may be performed in many different ways, since 
the labels of the particles may be permutated without changing the population numbers in the 
cells. This means that many specific allottments pertain to a single partitioning. Assuming 
that the allotments are elementary events of equal probability, we simply count the number of 
possible allottments to calculate the probability of the respective partitioning. 

The number of possible permutations of particle labels for a given partition ft = {rij] j = 
1, . . . , m} is 

N\ 

P(n) = -^—^ (2.20) 

ni\n 2 \ . ■ . n m \ 

(In combinatorics this is called permutations of m elements - i. e. cell numbers - with repetition). 



29 



Since each allottmcnt is equally probable, the most probable partitioning is the one allowing 
for the largest number of allottments. In many physically relevant cases the probability of that 
optimal partitioning very much larger than that of any other, meaning that we can restrict 
the further discussion to this one partitioning. (See the previous discussion of the multinomial 
distribution.) 

Thus we want to determine that specific partitioning n* which renders the expression 2.20 a 
maximum, given the additional constraints 

m ra 

Y n i~ N = and Y n i E i ~E = (2.21) 

Since the logarithm is a monotonically increasing function we may scout for the maximum 
of InP instead of P — this is mathematically much easier. The proven method for maximizing a 
function of many variables, allowing for additional constraints, is the variational method with 
Lagrange multipliers (see Problem 2.1). The variational equation 

dlnP-6 ^aY^nj+PY^Ejn^j =0 (2.22) 

with the undetermined multipliers a and [3 leads us, using the Stirling approximation for InP, 
to 

-Inn* -a-PEj =0 (2.23) 
Thus the optimal partitioning n* is given by 

n* = e - a - f3E i ■ j = l,...m (2.24) 

Consequently 

f(fj,Vj) oc n* = Aexv{-PE(rj,Vj)} (2.25) 

In particular, we find for a dilute gas, which in the absence of external forces will be homogeneous 
with respect to r, 

f(vj) = Bex V {-f3(mv 2 /2)} (2.26) 
Using the normalizing condition J f(v)dv = 1 or 

B J 4irv 2 e-P mv2 / 2 dv = 1 (2.27) 
we find B = (/3m/27r) 3 ^ 2 and therefore 



f(v) 



f3m 



2tt 



3/2 



e -' 3mv2 / 2 (2.28) 



Now we take a closer look at the quantity (3 which we introduced at first just for mathematical 
convenience. The mean kinetic energy of a particle is given by 

(E) = J dv(mv 2 /2)f(v) = JL (2.29) 

But we will learn in Section 2.3 that the average kinetic energy of a molecule is related to the 
macroscopic observable quantity T (temperature) according to (E) = 3fcT/2; therefore we have 
(3 = 1/kT. Thus we may write the distribution density of the velocity in the customary format 

M= [^f\' 2 ^ mv2,2kT ( 2 - 3 °) 
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Figure 2.3: Maxwcll-Boltzmann distribution 



This density in velocity space is commonly called Maxwell-Boltzmann distribution density. 

The same name is also used for a slightly different object, namely the distribution density of the 
modulus of the particle velocity (the "speed") which may easily be derived as (see equ. 1.66). 



f(\v\) = 4irv 2 f(v) = 4tt 



3/2 



v 2 e -mv 2 /2kT 



(2.31) 



-2nkTl 

So we have determined the population numbers n* of the cells in /i space by maximizing 
the number of possible allottmcnts. It is possible to demonstrate that the partitioning we have 
found is not just the most probable but by far the most probable one. In other words, any 
noticeable deviation from this distribution of particle velocities is extremely improbable (see 
above: multinomial distribution.) This makes for the great practical importance of the MB 
distribution: it is simply the distribution of velocities in a many particle system which we may 
assume to hold, neglecting all other possible but improbable distributions. 



As we can see from the figure, f(\v\) is a skewed distribution; its maximum is located at 

(2.32) 



2kT 



m 

This most probable speed is not the same as the mean speed, 

dwf(\v\) = 

or the root mean squared velocity or r.m.s. velocity) 

Vrms = = 



3fcT 



(2.33) 



(2.34) 



Example: The mass of an ff 2 molecule is m — 3.346 • 10 27 kg; at room temperature 
(appr. 300 if) we have kT = 1.380 • 10~ 23 .300 = 4.141 • 10~ 21 J; therefore the most 
probable speed of such a molecule under equilibrium conditions is v — 1.573- 10 3 m/s. 
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2.3 Thermodynamics of dilute gases 



The pressure of a gas in a container is produced by the incessant drumming of the gas molecules 
upon the walls. At each such wall collision - say, against the right wall of a cubic box - the 
respective momentum of the molecule p x = mv x is reversed. The momentum transferred to the 
wall is thus Ap x — 2mv x . The force acting on the unit area of the wall is then just the time 
average of the momentum transfer: 

IK\ 1 M(t) 1 M(t) 

k=l k=l 

where M(t) is the number of wall impacts within the time t. 

To obtain a theoretical prediction for the value of the pressure we argue as follows: 

The number of particles having x-velocity v x and impinging on the right wall per unit time is 

obviously proportional to v x . The momentum transfer from such a particle to the wall is 2mv x . 

Thus we find 

N f 

P = — / dv2mv 2 x f{v) (2.36) 
Inserting the Boltzmann density for f(v) and performing the integrations we have 



Simulation: Thermodynamics of dilute gases 

3-dimensional system of hard spheres in a cubic box. The pressure is determined 

- from the collisions of the particles with the container walls (P ex ) 

- from equation 2.37 (Pth)- 
[Code: Hspheres] 
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Where do we stand now? Just by statistical reasoning we have actually arrived at a prediction 
for the pressure - a thermodynamic quantity! 

Having thus traversed the gap to macroscopic physics we take a few steps further. From 
thermodynamics we know that the pressure of a dilute gas at density p = N/V and temperature 
T is P = pkT. Comparing this to the above formula we find for the mean energy of a molecule 

(E) = ?f , (2.38) 

and the parameter [3 (which was introduced in connection with the equilibrium density in velocity 
space) turns out to be just the inverse of kT. 

The further explication of the dilute gas thermodynamics is easy. Taking the formula for the 
internal energy, E = N(E) = 3NkT/2, and using the First Law 

dQ = dE + PdV (2.39) 
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we immediately find that amount of energy that is needed to raise the temperature of a gas by 
1 degree - a.k.a. the heat capacity Cy. 




(2.40) 



2.4 Transport processes 

A system is in "equilibrium" if its properties do not change spontaneously over time. (In case there 
are external fields - such as gravity - the material properties may vary in space, otherwise they 
will be independent also of position: the system is not only in equilibrium but also homogeneous.) 

In particular, in equilibrium the local energy density, i.e. the energy contained in a vol- 
ume element dV divided by that dV, as well as the momentum density and the particle or 
mass density remain constant. These densities, which refer to the three conserved quantities of 
mechanics, play a special role in what follows. 

Again considering the dilute gas, and assuming there are no external fields, the densities are 



By looking more closely we would see that these local densities are in in fact not quite constant; 
rather, they will fluctuate about their mean. In other words, there will be a spontaneous waxing 
and waning of local gradients of those densities. Also, the experimentor may intervene to create 
a gradient. For instance, one might induce in a horizontal layer of a gas or liquid a certain x- 
velocity u x ^ 0, and thereby a momentum p x . The difference between the momenta in adjacent 
layers then defines a gradient of the momentum density. If we left the system to itself this gradient 
would decrease and eventually vanish. The property governing the speed of this decrease is called 
viscosity. 

If a physical quantity - such as mass, or momentum - is conserved, any local change can only 
be achieved by a flow into or out of the space region under consideration; we are then speaking 
of transport processes whose speeds are governed by the respective transport coefficients 
- such as the viscosity r], the heat conductivity A (for the energy transport) and the diffusion 
constant D (for mass transport). 

In real experiments aimed at determining these transport coefficients the respective gradient 
is artificially maintained. Thus there will be a continuing flow of momentum, energy or matter in 
the (reverse) direction of the gradient - which is obviously a non-equilibrium situation. However, 
by a careful setup we can keep at least these flows and the local densities and gradients constant 
in time. This is called a stationary non-equilibrium situation. 

DEFINITION OF TRANSPORT COEFFICIENTS 

In order to define the transport coefficients r/, A and D we consider the basic experimental setup. 

• Viscosity: To measure the coefficient of momentum transport r\ we generate a laminary 
flow by placing a gas or fluid layer between two horizontal plates and moving the upper 
plate with constant velocity uq to the right. In this manner we superimpose a systematic 
x-velocity onto the random thermal motion of the molecules. 

The magnitude of the thermal speed is of the order 10 3 to/s; by adding a "shear velocity" 
u x (z) of some centimeters per second the local equilibrium is not considerably disturbed. 
Thus we may assume that we have still a Maxwcll-Boltzmann distribution of velocities at 
any point in the fluid, with the same value of (E) (bzw. kT) everywhere. 

Yet by imposing a velocity gradient we have slightly perturbed the equilibrium; a certain 
amount of ^-momentum will flow against the gradient - in our case downwards - so as to 
reestablish equilibrium. The amount of momentum flowing down through a unit of area 




and p m = 



Nm 



V 



(2.41) 
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per unit of time is called flow density j p . In a first (linear) approximation this flow will 
be proportional to the imposed velocity gradient, and the coefficient of proportionality is, 
by definition, the transport coefficient 77: 

This defining equation for r\ is often called Newton's law of viscous flow. The parameter 
77 is known as viscosity. 



Thermal conductivity: To generate a gradient of energy density we may place the sub- 
stance between two heat reservoirs with different temperatures, if we use the same simple 
geometry as for the viscosity then the temperature (or energy) gradient will have only the 
one non-vanishing component dT /dz which accordingly produces a flow of energy in the 
counter direction. The coefficient A of thermal conduction is defined by (Fourier's law), 

Diffusion constant: Even in a homogeneous gas (or a fluid, or a solid, for that matter) 
the individual molecules will alter their positions in the course of time. This process is 
known as self diffusion. It is possible to "tag" some of the particles - for instance, by 
giving them a radioactive nucleus. The density of the marked species - call it 1 - may then 
once more have a gradient that will be balanced by a particle flow (Fick's law): 

(,44) 



MEAN FREE PATH 

We will presently attempt to calculate the above defined transport coefficients from the micro- 
scopic dynamics of the molecules. In a simple kinetic treatment the elementary process deter- 
mining the various flows is the free flight of a gas particle between two collisions with other 
molecules. Thus the first step should be an estimation of the average path length covered by a 
particle between two such collisions. 

Let P(x) be the - as yet unknown - probability that a particle meets another one before 
it has passed a distance x. Then 1 — P(x) is the probability for the molecule to fly a distance 
x without undergoing a collision. But the probability of an encounter within an infinitesimal 
path element dx is given by p — pa 2 Trdx, where a is the diameter of the particles, (p equals the 
fraction of the "target area" covered by other particles.) Thus the differential probability for a 
collision between x and x + dx is 

dP{x) = [1 - P(x)]pa 2 Trdx (2.45) 

which upon integration yields 

P(x) = 1 - e - pa27TX (2.46) 
The probability density p(x) = dP(x)/dx for a collision within that interval is 

p(x) = pa 2 ne- pa2lTX (2.47) 

The mean free path is then the first moment of this density: 

,00 1 

l = (x)= / dxxp(x) = — — (2.48) 
Jo P<7 2 k 
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Example: The diameter of a H2 molecule is a 10" 10 m (= 1 Angstr0m). According 
to Loschmidt (and the later but more often quoted Avogadro) a volume of 22.4 • 
10 _3 m 3 contains, at standard conditions, 6.022 • 10 23 particles; the particle density is 
thus p — 2.69 • 10 25 m~ 3 , and the mean free path is I = 1.18 • 10~ 6 m. 



Simulation: Collision rate in a dilute gas 

3-dimensional system of hard spheres in a cubic box: 
- Compare the theoretical collision rate Z t h with the empirical one Z t 
[Code: Hspheres] 
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ESTIMATING THE TRANSPORT COEFFICIENTS 

In the case of a dilute gas we can actually find expressions for the transport coefficients. Assuming 
once more the basic geometric setting used in most experiments, we suppose that the gradient of 
the respective conserved quantity has only a z component, leading to a flow that is also directed 
along the z axis. 

• Viscosity: In the course of the random (thermal) motion of the particles the small sys- 
tematic term u x (z) is carried along. On the average, an equal number of particles will 
cross the interface between two horizontal layers from below and above. However, since 
the upper layer has a larger u x (assuming du x /dz > 0, it will gradually slow down, while 
the lower layer will take up speed. The flow of momentum due to this mechanism can be 
estimated as follows: 

The mean number of particles crossing the unit of area from below and from above, respec- 
tively, is p(v)/6. Each of the molecules carries that systematic u x (z) which pertains to the 
layer of its previous collision, i.e. u x (z ± I). The momentum flow density is therefore 



jp = Qp(v) [mu(z -I)- mu(z + I)} w ^p{v) 



-2m— I 

dz 



(2.49) 



Comparing this to the defining equation for the viscosity rj we find 



(2.50) 



It is a somewhat surprising consequence of this formula that, since I oc l/p, the viscosity 
eta is apparently independent of density! Maxwell, who was the first to derive this result, 
had to convince himself of its validity by accurate experiments on dilute gases. 
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• Thermal conductivity: A similar consideration as in the case of momentum transport 
yields, with je = —XdT/dz, 

A = -pl(v)mcv (2-51) 
where cy = Cy/M is the specific heat (Cy.. molar heat capacity; M. .molar mass). 

• Diffusion: Again we assume a gradient of the relevant density - in this case, the particle 
density of some species 1 - along the z direction. Writing j\ — —Ddpi/dz and using the 
same reasoning as before we find 

D = (2.52) 



2.5 Just in case ... 

... someone has forgotten how to find the extremum of a many- variable function under additional 
constraints. To remind you: the method of undetermined Lagrange multipliers waits to be applied 
here. 

Let f(x,y) — x 2 + y 2 be the given function. Of course, this is the equation of a parabolid 
with its tip - or minimum - at the origin. However, let g(x, y) = x — y — 1 = be the constraint 
equation, meaning that we don't search for the global minimum but for the minimum along the 
line y = x — 1. There are two ways to go about it. The simple but inconvenient way is to 
substitute y = x — 1 in f(x,y), thus rendering / a function of x only. Equating the derivative 
df/dx to zero we find the locus of the conditional minimum, x = 1/2 and y = —1/2. The process 
of substitution is, in general, tedious. 

A more elegant method is this: defining a (undetermined) Lagrange multiplier a, find the 
minimum of the function f(x, y) — a g(x, y) according to 

Eliminating a we find the solution without substituting anything. In our case 

2x-a = Q (2.55) 
2y + a = Q (2.56) 

+ y = 0, and from g(x, y) = 0: (x, y) = (1/2, -1/2). 



2.6 Problems for Chapter 2 



EXERCISES: 

2.1 Variational method of Lagrange: Determine the minimum of the function f(x,y) = 
x 2 + 2y 2 under the condition (i.e. along the curve) g(x, y) = x + y — 6 = 0, by two different 
methods: 

a) by inserting y — 6 — x in f(xy) and differentiating by x; 

b) using a Lagrange multiplier a and evaluating Lagrange's equations df/dx — a(dg/dx) = 
and df/dy — a(dg/dy) — 0. (Shorthand notation: 8f — aSg = 0; 5f ... "Variation of /"). 
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For your better understanding sketch the functions f(x, y) and g(x, y) = 0. 

2.2 Method of the most probable distribution: Having understood the principle of La- 
grange variation, reproduce the derivation of the Boltzmann distribution of energies (see text). 
Compare your result with the bottom right histogram in Applet LBRoulette. 

2.3 Moments of the Maxwell-Boltzmann distribution: Verify the expressions for the most 
probable velocity, the average and the r.m.s. velocity. 

2.4 Pressure in a dilute gas: Verify the formula P = (2/3)(N(E)/V). 

2.5 Transport properties: For nitrogen under standard conditions, estimate the mean free 
path and the transport coefficients r], A and D. (a w 4 • 10~ 10 m). 



TEST YOUR UNDERSTANDING OF CHAPTER 2: 

2.1 Maxwell-Boltzmann distribution: What is the formula for the distribution density fo(v) 
of the molecular velocities in equilibrium; what is the respective formula for the speeds (absolute 
values of the velocity), /o(H)? 

2.2 Pressure in an ideal gas: Derive the pressure equation of state for the ideal gas from 
simple kinetic theory. 

2.3 Transport coefficients: 

Write down the defining equation for one of the three transport coefficients. 

- What is the mean free path in a gas of spheres with diameter cr? 

- How does the viscosity of a dilute gas depend on the density? 
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Chapter 3 

Phase space 




Figure 3.1: Josiah Willard Gibbs 



The Kinetic Theory explained in Chapter 2 is applicable only to gases and - with certain add-ons 
- to fluids. A more general and extremely powerful method for analyzing statistical-mechanical 
systems is based on a geometrical exploration of the high-dimensional phase space spanned by 
the complete set of microvariables. 

3.1 Microscopic variables 

The microscopic state of a model system is uniquely determined by the specification of the 
complete set of microscopic variables. The number of such variables is of the same order as 
the number of particles. In contrast, the macroscopic state is specified by a small number 
of measurable quantities such as net mass, energy, or volume. Generally a huge number of 
different microstates are compatible with one single macrostate; and it is a primary task of 
statistical mechanics to find out just how many microstates there are for a given set of macroscopic 
conditions. 

Interpreting the microscopic variables as coordinates in a high-dimensional space we may 
represent a particular microstate as a point or vector in that space. The space itself is called 
Gibbs phase space; the state vector is often symbolized as T. 
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Figure 3.2: Phase space of the 2D quantum gas 

Consider a simple, classical many-particle system - say, an ideal gas, or a fluid made up of 
hard spheres or Lennard- Jones molecules. The state vector is then defined by all position and 
velocity coordinates: 

f = {fi, . . . ,r N ;v\, . . . ,v N } neV; v^ a e(±oo) (3.1) 

The number of degrees of freedom (d.o.f.) is n — 6N (or, in 2 dimensions, AN); the number 
of velocity d.o.f. is 3iV (or 2N). It is often allowed - and always advantageous - to treat the 
subspaces T r = {fi} (position space) and T v = {fi} (velocity space) separately. 

The representation of a microstate of the entire system by a single point in 6iV-dimcnsional 
Gibbs space must not be mixed up with the treatment of Chapter 2, introduced by Boltzmann. 
The ^i-space defined there had only 6 dimensions {r, v}, and each particle in the system had 
its own representative point. Thus the microstate of a system of N particles corresponded to a 
swarm of N points {f, Vi}. 

In the case of an ideal quantum gas it suffices to specify all quantum numbers to define a 
state: 

f = {(n ix , n ly , n lz ); i = l,...N} (3.2) 



Model systems made up of N spins are specified by 

f ={ai- i = l,...N} (3.3) 

with tr, = ±1. 
ENERGY SURFACE 

We consider a collection of M systems, all having the same energy E, the same number of particles 
N, and - in the case of a gas or fluid - the same volume V. All microstates T compatible with 
these macroscopic conditions are then equally probable, that is, they have the same relative 
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frequency within the ensemble of systems. The size M of the ensemble is assumed to be very 
large - indeed, to approach infinity. 

The assumption that all microstates that are compatible with the condition E = E have 
the same probability is one of the solid foundations Statistical Mechanics is built upon. It is 
called the "postulate of equal a priori probability" . For a mathematically exact formulation of 
this axiom we use the phase space density which is supposed to have the property 

*'•«-{? ™ = £ " (34) 

The condition E = const defines an (n — l)-dimcnsional "surface" within the n-dimensional phase 
space of the system. The set of all points upon that "energy surface" is named micro canonical 
ensemble. To take an example, in the 3iV-dimensional velocity space of a classical ideal gas the 
equation 

E kin = y v i = const = E ° ( 3 - 5 ) 

i 

defines the (3 AT — l)-dimensional surface of a 3iV-sphere of radius r = y / 2Eo/m. 

A typical question to be answered by applying statistical methods to such an ensemble is this: 
what is the average of the squared particle velocity (vf) over all - a priori equally probable - 
states on this surface? 

ERGODICITY 

Instead of considering an ensemble of systems let us now watch just one single system as it evolves 
in time according to the laws of mechanics. In a closed system the total energy will remain 
constant; the microstates visited by the system must therefore lie on the (AT — l)-dimensional 
energy surface defining the microcanonical ensemble. 

The ergodic hypothesis states that in the course of such a "natural evolution" of the 
system any permitted microstate will be reached (or closely approximated) with the same relative 
frequency. 

This hypothesis cannot be proven in general; in fact, it does not always hold. However, for 
many relevant systems such as gases or fluids under normal conditions it is quite true. In such 
cases the time to needed for a sufficiently thorough perambulation of the energy surface is in the 
range of 10~ 9 — 10~ 6 seconds, i.e. safely below the typical observation time in an experiment. 
Among those systems which we may characterize as "barely ergodic" or non-ergodic we have 
supercooled liquids and glasses. In such systems the state vector T remains trapped for long 
times in a limited region of the energy surface; it may then take seconds, days, or even centuries 
before other parts of the microcanonical surface are reached. 

The ergodic hypothesis, if true, has an important practical consequence: for the calculation of 
mean values over the microstates on the energy surface it does not matter if we take the average 
over states randomly picked from a microcanonical ensemble, or over the successive states of one 
single, isolated system. This corrolary of the ergodic hypothesis is often succinctly stated as 

ensemble average = time average 

The assumption of ergodicity enables us to support our theoretical arguments by "molecular 
dynamics" computer experiments. These are deterministic simulations reproducing the temporal 
evolution of a single isolated A^-particle system. We will later touch upon another kind of com- 
puter simulation, in which the state space is perambulated in a stochastic manner; it bears the 
suggestive name "Monte Carlo simulation" . 

ENERGY SHELL 

In place of the strict condition E — E we will generally require the weaker condition E — AE 
< E < E to hold. In other words, the permitted states of the system are to be restricted to a 
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Table 3.1: State spaces of some model systems 



thin "shell" at w _Eo- This more pragmatic requirement - which is made to keep the mathe- 
matics simpler - agrees well with the experimental fact that the exchange of energy between a 
system and its environment may be kept small, but can never be completely suppressed. 
Thus we assume for the density in phase space that 

For the classical ideal gas this requirement reads 1 

E — AE < E km = (m/2) v f < E o (3-7) 

i 

For the ideal quantum gas we require 

Eo - AE < E N , H = J2 ^ ^ E ° ( 3 - 8 ) 

i 

In a system of N non- interacting spins the energy shell is defined by —H J2i a i 6 [Eq,AE]. 

Table 3.1 presents an overview of the state spaces and energy functions for various model 
systems. 

PHASE SPACE VOLUME AND THERMODYNAMIC PROBABILITY 

Let us now recall the fundamental assumption that all microstates having the same energy are 
equally probable. Thus they represent elementary events as defined in Section 1.3. 

It follows then that a macrostate that allows for more microstates than others will occur more 
often and thus will be more probable. 

1 In an MD simulation not only the total energy but also the total momentum P is conserved; this should 
be kept in mind when comparing simulation results to theoretical statements. Actually, the four conditions 
E e (Eo — AE, Eo) and P = const, would define a 3N — 3-dimcnsional spherical shell in velocity space. However, 
for sufficiently numerous particles (N > 100) this detail may be neglected, and we can base the argumentation 
just on the condition E fss Eq (with a 37V-dimcnsional shell). 
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As an example, we may ask for the probability to find all molecules of an ideal gas in the left 
half of the vessel, with no other restrictions on position or speed. All such microstates are located 
in a small part of the total permitted phase space shell [E, AE]; they make up a sub-ensemble of 
the complete microcanonical ensemble. Now, the probability of the macrostate "all particles in 
the left half of the container" is obviously equal to the size ratio of the subensemble and the total 
ensemble. We will have to compare the volume (in phase space) of the partial shell pertaining 
to the subensemble to the volume of the total shell. (We will see later that the ratio of the two 
volumes is (1/2 N ) and may thus be neglected - in accordance with experience and intuition.) 

3.2 From Hyperspheres to Entropy 

Some model systems have the convenient property that their energy may be written as a sum 
over the squares of their microvariables. The most popular example is the classical ideal gas 
with E = Ekin = ( m /2)J2 v i ■ The conditions E < E or E w E then describe a high- 
dimensional sphere or spherical shell, respectively. Thus it will be worth the while to make 
ourselves acquainted with the geometrical properties of such bodies. It must be stressed, however, 
that the restriction to n-spheres is only a matter of mathematical convenience. It will turn 
out eventually that those properties of n-dimensional phase space which are of importance in 
Statistical Mechanics are actually quite robust, and not reserved to n-spheres. For instance, the 
n-rhomboid which pertains to the condition ^ Oi w const for simple spin systems could be (and 
often is) used instead. 

VOLUME AND SURFACE OF HIGHDIMENSIONAL SPHERES 

In the following discussion it will be convenient to use, in addition to the sphere radius r , a 
variable that represents the square of the radius: z = rjj. In the phase space of interactionless 
many-particle systems, this quantity is related to an energy, as may be seen from equs. 3.7, 3.8 
and Table 3.1); and in an isolated system it is just the energy which is given as a basic parameter. 



It should be kept in mind that the energy - and thus the square of the sphere radius - is an 
extensive quantity, meaning that it will increase as the number of degrees of freedom (or particles) : 
z oc n. It would be unphysical and misleading to keep z at some constant value and at the 
same time raise the number of dimensions. 

VOLUME 

The volume of a n-dimensional sphere with radius r = y/zo is 



Attention: 



7T 



.n/2 



V n (z ) = C n r% = C n z% /z with C, 



(n/2)! 



(3.9) 



where (1/2)! = y/n/2 and (x + 1)1 = x\(x + 1). The following recursion is useful: 




(3.10) 



Examples: C\ =2, C 2 = 7r, C 3 = ir : 
8tt 2 /15, C 6 =tt 3 /6, . .. C12 = tt 6 /720,... 



• 3 / 2 /(3/2)! = 47T/3, C 4 



tt 2 /2, C 5 = 



For large n we have, using Stirling's approximation for (n/2)! 



27re 



-i n/2 




c, 



n 



n 



(3.11) 
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As soon as the Stirling approximation holds, i.e. for n > 100, the hypersphere volume may be 
written ^ 

V^o) ~ — 1= { — J Za /2 or lnK(2 ) = T^ln ( — z ) -InVTm (3.12) 

Going to very large n(> 500) we hnd for the logarithm of the volume (the formula for V proper 
is then difficult to handle due to the large exponents) 

lnV n (*o)»^ln(^s ) (3-13) 



Example: Let n = 1000 and z = 1000. For the log volume we find In Viooo(lOOO) = 
500 ln(27re) - In \/T000^ = 882.76 



SURFACE AREA 

For the surface area of a n-dimcnsional sphere we have 

-~ , \ dVn(zo) (n-l)/2 /, ,,i 

°n{zo) = — — = nC n z y (3.14) 



Examples: 



dr 

Vi(*o)=2r , Oi(z ) = 2 

V 2 (z ) = kz 0i O 2 {z ) = 2irr 

V 3 (z ) = (47r/3)rg, O 3 (z )=4^ 

V 4 (*o) = (tt 2 /2)2 2 , O 4 (z ) - 2n 2 r* 



A very useful representation of the surface is this: 

O„(r ) = f ° dn^O n _i(r 2 ) (3.15) 



with r2 = \/r 2 — r 2 . This formula provides an important insight; it shows that the "mass" of a 
spherical shell is distributed along one sphere axis (ri) as follows: 



rp On-M) = (n - !)(? „_! r."" : 
t-2 O n (r ) nC n 

Examples: Let r = 1; then we find (see Fig. 3.3) 



p 2 (n) = -{i-r\r 1/2 

7T 

P3( r i) = ^ (constant)) 
o 

f>4(^i) = — (1 ~ r i) 1 ^ 2 (The astute reader notes that for once we 

Mn) = j(i-^) 

have kept r = 1, regardless of the value of n; this is permitted here because we are 
dealing with a normalized density p n ) 
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Figure 3.3: Mass distribution p{r\) of a (n — l)-dimensional spherical surface along one axis. 
With increasing dimension the mass concentrates more and more at the center of the axis. If 
we interprete the surface as the locus of all phase space points with given total energy Eki n = 
(m/2) ^2 v ii then p(ri) = p(vi) is just the distribution density for any single velocity component 



Application: Assume that a system has n degrees of freedom of translatory motion. 
(Example: n particles moving on a line, or n/3 particles in 3 dimensions.) Let the sum 
of squares of all velocities (energy!) be given, but apart from that let any particular 
combination of the values V\,V2,-- ■ be equally probable. All "phase space points" 
v = {vi...v n } are then homogeneously distributed on the spherical surface O n (\v\ 2 ), 
and a single velocity vi occurs with probability density 3.16. 

As we increase the number of dimensions, the character of this density function 
changes dramatically at first (see Fig. 3.3). If just two particles on a line (or the 
two d.o.f. of a pin ball) share the total energy mv 2 /2, then the velocity of one of 
them is most probably near the possible maximal value while the other has only a 
small speed. In contrast, for many dimensions (or particles) the maximum of the 
probability density p n {v\) is near zero. The case n = 3, meaning 3 particles on a line 
or one particle in 3 dimensions, is special: all possible values of V\ occur with equal 
probability. 

Approach to the Maxwell-Boltzmann distribution: For very large n we have 

Pn ^ M /0V2Y cx P {-« 2 /2(« 2 )} (3.17) 

with (v 2 ) — 2Eo/nm. 

The Maxwell-Boltzmann distribution may thus be derived solely from the 
postulate of equal a priori probability and the geometric properties of 
high-dimensional spheres. 



44 




Figure 3.4: Bunimovich's stadium billard. Distribution of flight directions, p(<f>) and of a single 
velocity component, p(v x ) 
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Figure 3.5: Simulation: N = 1 to 3 hard disks in a 2D box with reflecting walls. Distribution of 
flight directions, p((f>), and of a single velocity component, p(v\ x ). Comparison with the theoretical 
distribution [Code: Harddisks] 



TWO AMAZING PROPERTIES OF HYPERSPHERES 

We have seen that spheres in high-dimensional spaces exhibit quite unusual geometrical proper- 
ties. In the context of Statistical Physics the following facts are of particular relevance: 

• Practically the entire volume of a hypersphere is assembled in a thin shell immediately 
below the surface 

• The volume of a hypersphere is - at least on a logarithmic scale - almost identical to the 
volume of the largest inscribed hyper- cylinder 

We will consider these two statements in turn. 



VOLUME OF A SPHERICAL SHELL 

The ratio of the volume AV n (ro — Ar, Tq) of a thin "skin" near the surface and the total volume 
of the sphere is 

A£ _ *-(,»- A,)- _ 1 _ (1 _ _ , _ exp{ _„ (ar/ro)} (3 . 18) 
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Figure 3.6: Simulation: One hard sphere in a box with reflecting walls. Distribution of one 
velocity component; demonstration of the special case n = 3 (where p(v\ x ) = const). [Code: 
Hspheres] 
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Figure 3.7: Simulation: N Lennard-Jones particles in a 2D box with periodic boundary condi- 
tions. Distribution of a velocity component, p(v\ x ). [Code: L Jones] 



or, using the quantities zq and Az: 



1 — exp[ 



n Az, 



V n 2 z 

For n — + oo this ratio approaches 1, regardless of how thin the shell may be! 



(3.19) 



At very high dimensions the entire volume of a sphere is concentrated immediately below the 
surface: 

W n (zo,Az)—>V n (zo), n»l (3.20) 



Example: n = 1000, Ar = r /100 -> AV/V = 1 - 4.3 • 10" 



HYPERSPHERES AND HYPERCYLINDERS 



4G 



The sphere volume V n (z ) may alternatively be written as 

pro 

KOo) = / dr 1 O ni {zi)V n - ni (z 2 ) 



r dv ni ( Z1 ) , v , , 

Jo dzi 

/ dV ni 
Jo 



( Zl )V n - ni {z - Zl ) (3.21) 



with n = y[z{. 
Example: 

f T " f Z ° 4:TT 7T 3 

V 6 (z ) = j dr 1 O 3 (z 1 )V 3 (z - Zl ) = j dn Anrl — (z - Zl f' 2 = —z 3 (3.22) 

Partitioning the integration interval [0, zq\ in equ. 3.21 into small intervals of size Az we may 
write 

K 

V n {z ) w AV ni (« fc ) V n - ni (z - z k ) (3.23) 
fe=i 

where AV ni (z k ) = V ni (kAz) - V m {{k - l)Az). 

Similarly, for the volume of the spherical shell we have 

j-ZQ K 

AV n (z )= dV ni ( Zl ) AV n - ni (z - Zl ) w Y^AV ni {z k )AV n - ni {z Q -z k ) (3.24) 

Remembering equ. 3.20 we may, for high enough dimensions n, n\ and (n — m), always write 
V in place of AV. Therefore, 

K 

V n (z ) « V m («fc) ^n-m (*b - «fc) (3.25) 
fe=l 

Now, the terms in these sums are strongly varying. For high dimensions there is always one 
single term that dominates the sum; all other terms may safely be neglected. To find this term 
we evaluate 

^[V ni (z)V n - ni (z -z)]=0 (3.26) 

From 

d \z n i/ 2 (z - z )^-ni)m 

^ 

we find for the argument z* that maximizes the integrand 3.21 or the summation term in 3.24 or 
3.25, 

z* = — z (3.28) 
n 

We have thus found a very surprising property of high-dimensional spheres which we may sum- 
marize by the following calculation rule: 



• Divide the given dimension niniii and n — ri\ such that also n\ » 1 and n — n\ » 1 
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• Find the maximum of the product f(z) = V ni (z) ■ V n - ni (zo — z) (or the maximum of the 
logarithm ln/(z)) with respect to z; this maximum is located at 

z* = —z (3.29) 
n 

• With this, the following holds: 

\nV n (z Q ) » lnV ni (z*) + lnV n - ni (z - z*) (3.30) 

and similarly, 

\nAV n (zo) « lnAV ni (z*) + lnAV n ^ ni (z - z*) (3.31) 



(Remark: in a numerical verification of these relation it must be remembered that the maximum 
of the function at the r.h.s. of 3.31 or 3.30 is very sharp indeed; it may be overlooked when the 
interval [0, zrj] is scanned in regular steps. It is better to localize z* first, then compare with 
slightly smaller and larger z.) 

The geometric interpretation of the relation 3.30 is amazing: 
On a logarithmic scale the volume of an ra-sphere equals the product of the volumes 
of two spheres in the subspaces ri\ and n — ri\. But this product may be understood 
as the volume of a hypercylinder that is inscribed in the rt-sphere and which has the 
"base area" in n\ space and the "height" in (n — n\) space. 

Example: n — 1000, m = 400, z = 1000: the maximum of the quantity ln/(z) = 
In V4oo(z) + In V(3oo(1000 — z) is located at z* = 400, and we have 

500 ln(27re) - In VIOOOtt w 200 ln(27re) - In V400vr + 300 ln(27re) - In V600tt 

1418.94-4.03 w 567.58- 3.57 + 851.36 - 3.77 (3.32) 



Enlropy seen from within: 

Hyper -Rectangles and Hyper-Circles 




Figure 3.8: Simulation: Hyperspheres and -cylinders. In a given hypersphere of dimension n 
we inscribe hypercylinders whose "base areas" and "heights" have ri\ and n — m dimensions, 
respectively. The hypercylinder with the maximum volume is identified: its log volume is almost 
equal to that of the circumscribed sphere. [Code: Entropyl] 
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DISCRETISATION OF PHASE SPACE; ENTROPY 

Returning from geometry to physics, we will from now on denote phase space volumes by T, 
reserving the symbol V for the volume of a system in real space. Thus, IV is the 3-/V-dimensional 
velocity phase space volume of a iV-particle system, F> refers to the positional subspace volume 
which usually will also have 3iV dimensions, and T denotes the full phase space (or volume in 
phase space) with 6iV dimensions. 

Depending on which model system we are considering, the microvariables are either continuous 
(classical manybody system) or discrete (quantum models, spin lattices.) In order to be able to 
"enumerate" the states in phase space it is opportune to introduce a raster even in the case of 
continuous microvariables. Thus we imagine the phase space of a TV-particle system to be divided 
into cells of size 2 

g = AxAv (3.33) 

Now let us consider a classical gas, or fluid, with particle number TV and volume V. In the 3N- 
dimcnsional velocity subspace of the 6iV-dimensional phase space the condition Eki n £ [E, AE] 
again defines a spherical shell whose volume is essentially equal to the volume of the enclosed 
sphere. The number of Av cells in (or below) this shell is 

AF- F- /OJ7\ 3N / 2 

£„(£, AE) s ^ „ . C 3 „ (-) /(A.)" (3.34) 

In the case of the ideal gas the contribution of the position subspace may be included in a simple 
manner; we write 

yN 

Sf = Ax 3N ( ' 3 ' 35 ' ) 



Thus the total number of cells in 67V space is 
X'(N,V,E) = i;^ = C 3N 



V /2£\ 3/2 l 
g 3 \ m ) 



1 /2ne 
V3Nn V 3iV 



3N/2 



V (IE 



g 3 \m 



3/21 N 



(3.36) 



Now we have to prematurely introduce a result of quantum statistics. One characteristic property 
of quantum objects is their indistinguishability. It is evident that the number of distinct 
microstates will depend on whether or not we take into account this quantum property. A 
detailed analysis which must be postponed for now leads up to the simple result that we have to 
divide the above quantity £'(JV, V, E) by N\ to find 

Y.(N,V,E) = Y.'{N,V,E)/N\ (3.37) 

which is now indeed proportional to the total number of physically distinct microstates. This 
rule is known as the rule of correct Boltzmann enumeration. 

It is characteristic of the physical "instinct" of J. W. Gibbs that he found just this rule for the 
correct calculation of X although quantum mechanics was not yet known to him. Ho proposed 
the 1/iV! rule in an ad hoc manner to solve a certain theoretical problem, the so-called Gibbs 
Paradox. 

The quantity £(iV, V, E) is a measure of the available phase space volume, given 
in units g 3N . The logarithm of T,(N,V, E) has great physical significance: it is - 
up to a prefactor k - identical to the entropy S(N, V, E) that was introduced in 



2 A particularly powerful formulation of classical mechanics, known as Hamilton's formalism, makes use of the 
variables q, p (position and momentum) in place of r , v (position and velocity.) In this notation the phase space 
cells have the size h = Aq Ap. 
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thermodynamics. At present, this identification is no more than a hypothesis; the 
following chapter will show how reasonable the equality 

S(N,V,E) = klnX(N,V,E) (3.38) 

really is. 

In the case of a classical ideal gas we find, using In N\ w iVlniV and neglecting In y/SNir in equ. 
3.36, 



S{N, V,E) = k In £(7V, V, E) = Nk In 



V ( AirEe 



N \3Nmg< 



3/2 



(3.39) 



This is the famous Sackur- Tetrode equation, named for the authors Otto Sackur and 
Hugo Tetrode. 

The numerical value of £, and therefore of S, is obviously dependent on the chosen grid size 
g. This disquieting fact may be mitigated by the following considerations: 

• As long as we are only comparing phase space volumes, or entropies, the unit is of no 
concern 

• There is in fact a smallest physically meaningful gridsize which may well serve as the natural 
unit of S; it is given by the quantum mechanical uncertainty: g m in — h/m 

Example: N = 36, m = 2, E = N — 36. The average energy per particle is then = 1, 
and the mean squared velocity is (v 2 ) = 1. Assuming a cubic box with V = L 3 = 1 
and a rather coarse grid with Ax = Av = 0.1 wc find 



S(N,V,E)/k = 36 In 



1 / 4-7r-36-e 
36 V3-36-2- 10~ 4 



3/2 



462.27 



(3.40) 



Just for curiosity, let us determine ln(AE), where AS is the phase space volume 
between E — 35.5 and 36.0: 



AS = S(36.0) - S(35.5) = S(36.0) 
and thus 



35.5 
"36" 



.->4 



£(36.0) • 0.53 (3.41) 



S(N, V, AE)/k = 462.27- 0.63 = 461.64 



(3.42) 



We see that even for such a small system the entropy value is quite insensitive to 
using the spherical shell volume in place of the sphere volume! 



3.3 Problems for Chapter 3 



EXERCISES: 

3.1 Geometry of n-spheres I: Calculate the volumes and surfaces of spheres with r = 
1.0 in 3,6,12 and 100 dimensions. In evaluating 100! use the Stirling approximation n\ w 

V&m(n/e) n . 

3.2 Geometry of n-spheres II: For the various n-spheres of the foregoing example, compute 
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the fraction of the total volume contained in a shell between r = 0.95 and r = 1.0. Comment the 
result. 

3.3 Approximate formula for \nV n (z n ): Choose your own example to verify the validity of 
the approximation 3.30. Put the meaning of this equation in words; demonstrate the geometrical 
meaning for a three-dimensional sphere - even if the approximation is not yet valid in this case. 
Make a few runs with Applet Entropyl and comment on your findings. 

3.4 Sackur- Tetrode equation: Calculate the entropy of an ideal gas of noble gas atoms; choose 
your own density, energy per particle, and particle mass (keeping in mind that the gas is to be 
near ideal); use the mimimal grid size in phase space, g = g m in = h/m. 



TEST YOUR UNDERSTANDING OF CHAPTER 3: 

3.1 Geometry of phase space: Explain the concepts phase space, energy surface, energy 
shell. 

3.2 Entropy and geometry: What is the relation between the entropy of a system and the 
geometry of the phase space? 

3.3 Geometry of n-spheres: Name a property of high-dimensional spheres that simplifies the 
entropy of an ideal gas. (Hint: shell volume?) 
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Chapter 4 

Statistical Thermodynamics 



4.1 Microcanonical ensemble 

We recall the definition of this ensemble - it is that set of microstates which for given N, V 
have an energy in the interval [E,AE]. The number of such microstates is proportional to the 
phase space volume they inhabit. And we found some reason to suspect that this volume - its 
logarithm, rather - may be identified as that property which the thermodynamicists have dubbed 
entropy and denoted by S(N, V, E). This can hold only if S has the two essential properties of 
entropy: 



1. If the system is divided into two subsystems that may freely exchange energy, then the 
equilibrium state is the one in which the available energy E = E\ + E 2 is distributed such 
that 



dS(Ni, Vi,Ei) 



dE 1 



dS(N 2 ,V 2 ,E 2 ) 



Ei—E* 



dE 2 



Eo — E — E^ 



The quantity T = [dS(N, V, E)/dE] 1 is commonly called temperature. 
2. In equilibrium the entropy S is additive: 

S(N U V u + S(N 2 , V 2 ,E 2 ) = S{N! + N 2l V x + V 2 ,E 1 + E 2 ) 



(4.1) 



(4.2) 



THERMAL INTERACTION 

Now consider two systems (A?i, V\, E\) and (N 2 , V 2 , E 2 ) in thermal contact, meaning that they 
can exchange energy but keeping the total energy E = E\ +E 2 constant; their "private" volumes 
and particles remain separated. We may determine the phase space volume of the combined 
system. 



Ad 1. The optimal partial energy E* fulfills T 2 {E 2 )dT 1 {E 1 )/dE 1 = T^E^ 8T 2 (E 2 )/dE 2 , or 

(4.3) 



This, however, is nothing else but the well-known thermodynamic equation 



dE± 



Ei—E* 



dS 2 (E 2 ) 
8E 2 



(4.4) 



Eo — E — E i 
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Figure 4.1: Isolated system: — > microcanonical ensemble 



or, with dS/dE=l/T, 



(4.5) 



Ad 2. Let the total energy be divided up according to E = E\ + E 2 . Then we have, by equ. 
3.30, 

T 1+2 (E)=T 1 {El)T 2 {E-E* 1 ) (4.6) 



and thus 



Sl+2 = fcln^i±^ = /,ln 



n 3N 



ri^j) r 2 {E-Et) 



n3Nl 



~,3N 2 



(4.7) 



where -Ej" is that partial energy of system 1 which maximizes the product Ti(Ei)T 2 (E — Ei). 



In other words, at thermal contact between two systems isolated from the outside world there 
will be a regular flow of energy until the quantity dS/dE (= 1/T) is equal in both systems. Since 
the combined system has then the largest extension in phase space, this will be the most probable 
distribution of energies upon the two systems. There may be fluctuations around the optimal 
energy distribution, but due to the extreme sharpness of the maximum of T\{Ei)Y 2 {E — E\) 
these deviations remain very small. 

It should be noted that these conclusions, although of eminent physical significance, may be 
derived quite simply from the geometrical properties of high-dimensional spheres. 



Example: Consider two systems with N± — N 2 = 36 and initial energies E\ = 36, 
Now bring the systems in thermal contact. The maximum value of the 



E 2 = 72 
product ri(Ei)r 2 (E 
volume is 



Ei) occurs at E{ = E^ = 54, and the respective phase space 



^(^^2(108-^*) 



36 ^ 6l ° 4 ) 



3/2 



(4.8) 
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How does another partitioning of the total energy - say, (46,62) instead of (54,54) - 
compare to the optimal one, in terms of phase space volume and thus probability? 



ri(46)r 2 (62) _ /46-62 x 51 



Ti(54)r 2 (54) V 54 ' 54 



0.30 (4.9) 



We can see that the energy fluctuations in these small systems are relatively large: 
SEi/El w 8/54 = 0.15. However, for larger particle numbers 8E\jE\ decreases as 
1/VN: (515 • 565/540 • 540) 540 = 0.31; thus 5E 1 /E{ w 25/540 = 0.05. 



THERMODYNAMICS IN THE MICROCANONICAL ENSEMBLE 

Let the system under consideration be in mechanical or thermal contact with other systems. The 
macroscopic conditions (V, E) may then undergo changes, but we assume that this happens in 
a quasistatic way, meaning that the changes are slow enough to permit the system always to 
effectively perambulate the microensemble pertaining to the momentary macroconditions. To 
take the iV-particle gas as an example, we require that its energy and volume change so slowly 
that the system may visit all regions of the the phase space shell (E(t), V{t)) before it moves to 
a new shell. Under these conditions the imported or exported differential energy dE is related to 
the differential volume change according to 

dS =(^) v dE+ (w)/ v <"»» 

Defining (in addition to T = (dSfdE)y 1 ) the pressure by 

then equ. 4.10 is identical to the thermodynamic relation 

dS= ^(dE + PdV) or dE = T dS - P dV (First Law) (4.12) 



Example: Classical ideal gas with 

S(N,V,E) = Nkln 



V ( AirEe 



N \3Nmg 2 



3/2' 



(4.13) 



Solving this equation for E we find for the internal energy U(S, V) = E the explicit 
formula 

U{S,V)=(^y 'a^e 3 ^*- 1 (4.14) 

From thermodynamics we know that T = (dUfdS)v', therefore 

2 U 

T =3» < 415 » 

From this we conclude, in agreement with experiment, that the specific heat of the 
ideal gas is 

C v = ^Nk. (4.16) 
The pressure may be found from P = —(dU/dV)s- 
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SIMULATION IN THE MICROCANONICAL ENSEMBLE: MOLECULAR DY- 
NAMICS 

We found it a simple matter to derive the entropy S of an ideal gas as a function of N, V and 
E; and once we had S(N, V, E) the subsequent derivation of thermodynamics was easy. To keep 
things so simple we had to do some cheating, in that we assumed no interaction between the 
particles. Statistical mechanics is powerful enough to yield solutions even if there are such inter- 
actions. A discussion of the pertinent methods - virial expansion, integral equation theories etc. 
- is beyond the scope of this tutorial. However, there is a more pragmatic method of investigating 
the thermodynamic properties of an arbitrary model system: computer simulation. The classical 
equations of motion of mass points interacting via a physically plausible pair potential u(r) such 
as the one introduced by Lennard- Jones read 




(4.18) 



If at some time t the microstate {r i7 Vi ; i = 1, . . .N} is given we can solve these equations of 
motion for a short time step At by numerical approximation; the new positions and velocities at 
time t + At are used as starting values for the next integration step and so forth. This procedure 
is known as molecular dynamics simulation. 

Since we assume no external forces but only forces between the particles, the total energy of 
the system remains constant: the trajectory in phase space is confined to the energy surface E = 
const. If the systems is chaotic it will visit all states on this hypersurface with the same frequency. 
An average over the trajectory is therefore equivalent to an average over the microcanonical 
ensemble. For example, the internal energy may be calculated according to {/, = (Ekin) + 
(E pot ), where Ekin may be determined at any time from the particle velocities, and E pot = 
(1/2) Si j u ( r ij) horn the positions. By the same token the temperature may be computed via 
3NkT/2 = (Ekin), while the pressure is the average of the so-called "virial"; that is the quantity 
W = (1/2) J2i J2j^ Kij ■ fij. In particular we have P = NkT/V + (W)/3V. 

In the case of hard spheres the particle trajectories are computed in a different manner. For 
given fi , i>i the time span to to the next collision between any two particles in the system is 
determined. Calling these prospective collision partners io and jo we first move all spheres along 
their specific flight directions by Ar^ = Vito and then simulate the collision (io,jo), computing 
the new directions and speeds of the two partners according to the laws of elastic collisions. Now 
we have gone full circle and can do the next to and io, jo- 

Further details of the MD method may be found in [Vesely 94] or [Allen 90] 

4.2 Canonical ensemble 

We once more put two systems in thermal contact with each other. One of the systems is supposed 
to have many more degrees of freedom than the other: 

n > n - m » m » 1 (4.19) 



The larger system, with n 2 = n — n\ d.o.f., is called "heat bath". The energy E 2 = E — E\ 
contained in the heat bath is "almost always" much greater than the energy of the smaller 
system; the heat reservoir's entropy may therefore be expanded around S2 (n 2 , E) : 

= S 2 (E) ^ (4.20) 

E'=E 1 



S2(E — Ei) ~ 82(E) — Ei 



dS 2 (E') 
dE' 
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Figure 4.2: System in contact with an energy reservoir: — ► canonical ensemble 



where T is the temperature of the heat bath. The number of phase space cells occupied by the 
larger system is thus 

E 2 (E-E 1 ) = e S2/k e- El/kT (4.21) 

But the larger — E\), the larger the probability to find system 1 in a microstate with energy 
Ei. We may express this in terms of the "canonical phase space density" pi(ri): 

pi[Ti{Ei)]= Po e- E ^ kT (4.22) 

where po is a normalizing factor, and 

pi(ri) = p[r u vi;E{ri,vi) = Ei] (4.23) 

is the density of microstates in that region of phase space of system 1 that belongs to energy Ei . 

For a better understanding of equ. 4.22 we recall that in the microcanonical ensemble only 
those states of system 1 were considered for which the energy Ei was in the interval [Ei , Ei — AE] . 
In the canonical ensemble all energy values are permitted, but the density of state points varies 
strongly, as exp[— Ei/kT]. 

Equation 4.22 may not be understood to say that the most probable energy of the smaller 
system be equal to zero. While the density of states in the phase space of system 1 indeed 
drops sharply with increasing E\, the volume Y\{E\) pertaining to Ei is strongly increasing as 
E™^ 2 . The product of these two factors, i.e. the statistical weight of the respective phase 
space region, then exhibits a maximum at an energy Ei ^ 0. 

As a - by now familiar - illustration of this let us recall the Maxwell-Boltzmann distribution: 
p(\v\ is just the probability density for the (kinetic) energy of a subsystem consisting of only one 
particle, while the heat bath is made up of the N — 1 other molecules. 

In the more general case, i.e. for a large number of particles, the peak of the energy distribution 
is so sharp that the most probable energy is all but identical to the mean energy: 

Af 1 

Thus we have found that even non-isolated systems which may exchange energy have actually 
most of the time a certain energy from which they will deviate only slightly. But this means that 
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we may calculate averages of physical quantities either in the microcanonical or in the canonical 
ensemble, according to mathematical convenience. This principle is known as "equivalence of 
ensembles" . 

We have derived the properties of the canonical ensemble using a Taylor expansion of the en- 
tropy. The derivation originally given by Gibbs is different. J. W. Gibbs generalized Boltzmann's 
"method of the most probable distribution" to an ensemble of microscopically identical systems 
which are in thermal contact with each other. 

Gibbs considered M equal systems (i — 1,...,M), each containing N particles. The sum 
of the M energies was constrained to sum up to a given value, £ = J2i with an unhindered 
interchange of energies between the systems. Under these simple assumptions he determined 
the probability of finding a system in the neighbourhood of a microstate T having an energy 
in the interval [E,AE]. With increasing energy E this probability density drops as p(T(E)) oc 
exp[— E/kT]. Since the volume of the energy shell rises sharply with energy we again find that 
most systems will have an energy around (E) — £/M. Thus the important equivalence of 
canonical and microcanonical ensembles may alternatively be proven in this manner. 

THERMODYNAMICS IN THE CANONICAL ENSEMBLE 

The quantity 

Q(N, V, T) eee J dfdve- E ^' kT (4.25) 

is called canonical partition function. First of all, it is a normalizing factor in the calculation 
of averages over the canonical ensemble. For example, the internal energy may be written as 

U=(E) = ^-L_ / drdvE(r, (4.26) 

But the great practical importance of the partition function stems from its close relation to 
Helmholtz' free energy A(N,V,T), which itself is a central object of thermodynamics. The 
relation between the two is 

Q(N,V,T) = e - 0A ( N ' v ' T ^ (4.27) 
where [3 = 1/kT. To prove this important fact we differentiate the identity 

J dfdve^ N ^~ E ^ = 1 (4.28) 



by /?, obtaining 



Nig 3 



A{N,V,T)-{E)+p( t ^) =0 (4.29) 



\d(3 



v 



or 



A(N,V,T)-U(N,V,T)-T^j =0 (4.30) 

But this is, with S = —{dA/dT)v, identical to the basic thermodynamic relation A = U — TS. 

All other thermodynamic quantities may now be distilled from A(N, V,T). For instance, the 
pressure is given by 



Similarly, entropy and Gibbs' free energy are calculated from 

'OA 
df 



■S =- (|^) and G= \ - !'\ (4.82) 
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Example 1: For the classical ideal gas we have 



Q(N,V,T) = ^ J drdveM-^fY,^ = ( 4 .33) 
q = J drdvcM-^Wl 2 } = (^P)' 2 V ( 4 -34) 



This leads to 

1 (2-nmkT 
and using A = —kTlnQ and 4.31 we find 



3N/2 



(4.36, 

which is the well-known equation of state of the ideal gas. Similarly we find from 
S = —(dA/dT)v the entropy in keeping with equ. 3.39. 

Example 2: The free energy of one mole of an ideal gas at standard conditions, as- 
suming a molecular mass of m = 39.95m// (i. e. Argon), is 

A = -kTlnQ = -4.25 • 10 7 J (4.37) 



We have now succeeded to derive the thermodynamics of an ideal gas solely from a geometrical 
analysis of the phase space of N classical point masses. It must be stressed that similar rela- 
tions for thermodynamical observables may also be derived for other model systems with their 
respective phase spaces. 

In hindsight it is possible to apply the concept of a "partition function" also to the micro- 
canonical ensemble. After all, the quantity ^(N, V, E) was also a measure of the total accessible 
phase space volume. In other words, we might as well call it the "microcanonical partition func- 
tion". And we recall that its logarithm - the entropy - served as a starting point to unfold 
statistical thermodynamics. 

EQUIPARTITION THEOREM 

Without proof we note the following important theorem: 



If the Hamiltonian of a system contains some position or velocity coordinate in quadratic form, 
the respective degree of freedom will have the mean energy kT/2. 



Example 1: The Hamiltonian of the classical ideal gas is 

N 3 2 



i— 1 a— 1 



Each of the 3N translational d.o.f. appears in the guise vf a . The equipartition 
theorem then tells us that for each velocity component 

m , 9 . kT m , 3fcT , , „. 

y(4>> = — or _(„,?) = _ (4.39) 
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(As there is no interactional or external potential, the positional d.o.f. contain no 
energy.) 



Example 2: Every classical fluid, such as the Lennard-Jones liquid, has the Hamilto- 
nian 

N 3 2 

H(f, v) = H pot (f) + Y^Y, J ^r (4 - 40) 



i— 1 a—1 



Therefore each of the 3N translatory d.o.f. contains, on the average, an energy kT/2. 
(The interaction potential is not quadratic in the positions; therefore the equipartition 
law does not apply to ri a .) 

Example 3: A system of N one-dimensional harmonic oscillators is characterized by 



the Hamiltonian 



Therefore, 



H(x, f) = H pot + H km = ^ X>* + y E *? ( 4 ' 41 ) 

i=l i=l 



f -(xj) = ^- and ^(±2) = ^. (4.42) 
2 2 2 2 

Thus the total energy of the TV oscillators is E = NkT . The generalization of this to 

three dimensions is trivial; we find Eid.cryst. — 3NkT. For the specific heat we have 

consequently Cy = (dE/dT)v = 3Nk. This prediction is in good agreement with 

experimental results for crystalline solids at moderately high temperatures. For low 

temperatures - and depending on the specific substance this may well mean room 

temperature - the classical description breaks down, and we have to apply quantum 

rules to predict Cy and other thermodynamic observables (see Chapter 5.) 

Example 4: A fluid of TV "dumbbell molecules" , each having 3 translatory and 2 
rotatory d.o.f, has the Hamiltonian 

H(f, e, ?, k) = H pot (r, e) + £ ^ + £ ^ (4.43) 

where e are the orientation vectors of the linear particles, co are their angular velocities, 
and / denotes the molecular moment of inertia. 

Thus we predict 

2>i) = — and 2^ = ~2~ ' ( } 

which is again a good estimate as long as a classical description may be expected to 
apply. 



CHEMICAL POTENTIAL 

Let us recall the experimental setup of Fig. 4.2. Allowing two systems to exchange energy leads 
to an equilibration of their temperatures T (see Section 4.1). The energies E\,E<± of the two 
subsystems will then only fluctuate - usually just slightly - around their average values. 

Let us now assume that the systems can also exchange particles. In such a situation we will 
again find some initial equilibration after which the particle numbers N\ , N 2 will only slightly 
fluctuate around their mean values. The flow of particles from one subsystem to the other will 
come to an end as soon as the free energy A = A\ + A 2 of the combined system tends to a 
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constant value. This happens when (8A\/dN)v — (dA%/dN)v- The quantity that determines 
the equilibrium is therefore \i = (dA/dN)v; the subsystems will trade particles until [i\ = \i2- 
(Compare this definition of the chemical potential with that of temperature, (dS/dE)y .) 



Example: The chemical potential of Argon (m = 39.95to# ) at normal conditions is 

= -7.26- 1(T 20 J (4.45) 



dA lrT1 d\nQ 



dN 



dN 



-fcTln 



V {2irmkT^ 3/2 



N V h 2 



SIMULATION IN THE CANONICAL ENSEMBLE: MONTE CARLO CALCULA- 
TION 

We may once more find an appropriate numerical rule for the correct "browsing" of all states 
with given (N, V, T) (in place of (N, V, E)). Since it is now the Boltzmann factor that gives the 
statistical weight of a microstate f = {ri,-^}, the average value of some quantity a(T) is given 

by 



(a) 



N,V.T 



J a(T)exp[-E(T)/kT]dT/ J exp[-E(f)/kT]df (4.46) 

If a depends only on the particle positions and not on velocities - and this is true for important 
quantities such potential energy, virial, etc. - then we may even confine the weighted integral to 
the 3A^-dimensional configurational subspace T c = {ft} of full phase space: 

(a) N ,v,T = J a(f c )cxp[-E pot (f c )/kT}df c / J exp[-E pot {f c )/kT]df c (4.47) 

In order to find an estimate for (a) we formally replace the integrals by sums and construct a 
long sequence of randomly sampled states T c (m);m — l,...M with the requirement that the 
relative frequency of microstates in the sequence be proportional to their Boltzmann factors. In 
other words, configurations with high potential energy should occur less frequently than states 
with small E pot . The customary method to produce such a biased random sequence (a so-called 
"Markov chain") is called "Metropolis technique", after its inventor Nicholas Metropolis. 

Now, since the Boltzmann factor is already contained in the frequency of states in the sequence 
we can compute the Boltzmann-weighted average simply according to 

M 

(«)^E"N ( 4 - 48 ) 

m— 1 

An extensive description of the Monte Carlo method may be found in [Vescly 1978] or [Vesely 
2001]. 

There is also a special version of the molecular dynamics simulation method that may be 
used to perambulate the canonical distribution. We recall that in MD simulations normally the 
total system energy E to t = Eki n + E pot is held constant, which is roughly equivalent to sampling 
the microcanonical ensemble. However, by introducing a kind of numerical thermostat we may 
at each time step adjust all particle velocities so as to keep Ekin either constant (isokinetic MD 
simulation) oder near a mean value such that (Ekin) oc T (isothermal MD). 

4.3 Grand canonical ensemble 

Once again we put a small system (1) in contact with a large one (2). However, this time we do 
not only permit the exchange of energy but also the crossing over of particles from one subsystem 
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to the other. 



And as before we can write down the probability density in the phase space of the smaller system; 
it depends now both on the number of particles Ni and on {ft, v^, i= l,...Ni}, as follows: 

p(r, v- cx e^/kT^Eif^/kT (4 4g) 

Summing this density over all possible values of N\ and integrating - at each Ni - over all 
{fi, Vi\ i = 1, . . . A?i} we obtain the grand partition function 

oo 

Z{n,V u T)= J2 e^^QiN^VuT) (4.50) 

Its value is just the "total statistical weight" of all possible states of system 1. Above all, it serves 
as the source function of thermodynamics. 

THERMODYNAMICS IN THE GRAND CANONICAL ENSEMBLE 

From the grand partition function we can easily derive expressions for the various thermodynamic 



observables. For instance, putting z = e^l kT and = 1/kT we find 

kT 

P = — In Z(z,V,T) (4.51) 

N(=(N)) = z ^-\nZ(z,V,T) = kT^- (4.52) 

U{=(E)) = -|-lnZ(z,t/,T) = fcT 2 ^ (4.53) 



As a rule the - permitted - fluctuations of the number of particles remain small; in particular 
we have AN/N w 1/y/N. Thus the grand ensemble is again equivalent to others ensembles of 
statistical mechanics. 

[To do: applet with MD simulation, averages taken only over particles in a partial volume ~l 
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same results!] 



Example: Let us visit the ideal gas again. For the grand partition function we have 

V N /27rm£-T\ 3N/2 
Z{z,V,T> = E^w(^) 

N v ' 

= ^yl^^yJ^f (4.54, 



Nl "~ \ h 2 

N x 



Therefore 



Z = exp 



-zV 



/2vrmfcT\ 



3/2' 



/ 2irmkT\ 



3/2 



or In Z = —zV ^— ^ — J (4.55) 



Using the formulae for internal energy and pressure we find 

lrT , /2TTmkT\ 3/2 1TT IfT1 3U /2irmkT\ 3/2 . . 

P = -kTz [-J^j and [/ = -fcTz— (— — J (4.56) 

Consequently, P = 2C//3U or 

2 37VfcT 7V lm 

p ^37^-y fcT (4 ' 57) 

in keeping with the phenomcnological ideal gas equation. 



SIMULATION IN THE GRAND CANONICAL ENSEMBLE: GCMC 

The states within the grand ensemble may again be sampled in a random manner. Just as in 
the canonical Monte Carlo procedure we produce a sequence of microstates T c (m), m = 1, . . . M 
with the appropriate relative frequencies. The only change is that we now vary also the number 
of particles by occasionally adding or removing a particle. The stochastic rule for these insertions 
and removals is such that it agrees with the thermodynamic probability of such processes. By 
averaging some quantity over the "Markov chain" of configurations we again obtain an estimate 
of the respective thermodynamic observable. 



4.4 Problems for Chapter 4 



EXERCISES: 

4.1 Canonical phase space density: Considering the Maxwell-Boltzmann distribution in a 
classical 3D fluid, show that 

a) with increasing kinetic energy Ek the density of states decreases as exp {—Ek/kT}; 

b) in spite of this the most probable kinetic energy is not zero. 
Apply this to the general canonical phase space. 

4.2 Grand canonical ensemble: Using the grand partition function, derive the mean number 
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of particles in one m 3 of an ideal gas at standard conditions. 



TEST YOUR UNDERSTANDING OF CHAPTER 4: 

4.1 Temperature and entropy: What happens if two systems are put in contact with each 
other such that they may exchange energy? 

4.2 Changes of state: What is a quasistatic change of state? 

4.3 Equipartition theorem: Formulate the equipartition theorem; to which microscopic vari- 
ables does it apply? Give two examples. 

4.4 Canonical ensemble: What are the macroscopic conditions that define the canonical en- 
semble? When is it equivalent to the microcanonical ensemble? 

4.5 Grand canonical ensemble: What are the macroscopic conditions defining the grand 
canonical ensemble? What is needed to make it equivalent to the canonical and microcanonical 
ensembles? 
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Chapter 5 

Statistical Quantum Mechanics 



Counting the states in phase space takes some consideration if we want to apply quantum me- 
chanics. We have already mentioned the fact that quantum particles are not distinguishable, and 
we took this into account in a heuristic manner, by introducing the permutation factor 1/N\ in 
the partition function. 

Another feature of the quantum picture is that state space is not continuous but consists 
of finite "raster elements": just think of the discrete states of an ideal quantum gas. Finally, 
it depends on the "symmetry class" of the particles how many of them may inhabit the same 
discrete microstate. Fermions, with a wave function of odd symmetry, can take on a particular 
state only exclusively; the population number of a raster element in pahese space can be just 
or 1. In contrast, even-symmetry bosons may in any number share the same microstate. 

What are the consequences of these additional counting rules for Statistical Thermodynamics? 
To seek an answer we may either proceed in the manner of Boltzmann (see Section 2.2) or a la 
Gibbs (see Chapter 4). For a better understanding we will here sketch both approaches. 

5.1 Ideal quantum gas: Method of the most probable dis- 
tribution 

We consider a system of TV independent particles in a cubic box with ideally elastic walls. In 
the spririt of the kinetic theory of dilute gases we explore the state space for the individual 
particles, which Boltzmann dubbed /u-space. In the quantum case this space is spanned by the 
quantum numbers n XtVtZ = 1,2... pertaining to the momentum cigenstates having eigenvalues 
p= (h/2L)n and energies En = p 2 /2m = (h 2 /8mL 2 )\n\ 2 . 

Now we batch together all states having energies Eft in an interval [Ej , AE] . The number of 
states in such a "cell" is named gj, j = 1, 2, . . . m. The values of the gj are not important; they 
should only be large enough to allow the application of Stirling's formula. 

As before we try to answer the question how the N particles should best be distributed over 
the m cells. To do so we change the notation from the one used in Section 2.2, in that we denote 
the number of particles in cell j by fj. The reason for using fj is that "n" is reserved for the 
quantum numbers. 

A specific distribution / = {fj; j = 1, . . . m} of the N particles to the m cells is more probable 
if its multiplicity W is larger, meaning that we can allot the {fj} particles in more different 
ways to the {gj} states in each cell - always keeping in mind the Fermi or Bose rules: 




(5.1) 
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To compare: the multiplicity given in Section 2.2, pertaining to a classical distribution (see equ. 

2.20) would in our present notation read W = YYjLi 9j J /fj- 

The distribution /* having the largest multiplicity may again be determined by Lagrange 
variation with the conditions J2j fjEj = E anc ^ J2j fj = 

S In W (35 ^2 fi E i ~ Ej + 7* (E U ~ = ( 5 - 2 ) 

Writing z = e 7 we find for 

Fermi - Dirac : /* = — Bose - Einstein : f * = — — fj? (5.3) 

J 3 z -l e f3Ej _|_ i J 3 z -\ e (iEj _ i V ) 

This is the most probable distribution of the particles upon the cells. Since gj denotes the number 
of states in cell j, we have for the average population number of each state 

(/«) = j. = z -iJ Ei ± i (+ • • • Fermi ; - • • • Bosc ) ( 5 - 4 ) 

It is easy to interpret the Lagrange parameters (3 and z. As in Section 2.2 one compares the 
consequences of the population densities given above to empirical/thermodynamical facts, finding 
that (3 is related to temperature as (3 = 1/ kT, and that z = e< = e^l kT is identical to the fugacity. 

For a better understanding of this derivation, let us interpret its premises as a set of rules 
in a game of fortune, as we have done in Chapter 2. By running the applet EFRoulette we may 
indeed play that game - for Fermi particles at least - and compare its outcome with the result 
just given. 

These are the rules: 

For non- interacting particles in a square box the ^i-planc is spanned by integers n x ,n y ; each quan- 
tum state is represented by a point. A specific state of a system of N fermions is represented by 
a set of N inhabited points on that plane. 

To find the average (and also most probable!) distribution of particles on states, 

- assign N particles randomly to the states on ^i-plane 

- make sure that the sum of the particle energies equals the given system energy, 
AND 

- discard all trials in which a state is inhabited by more than one particle 

- determine the mean number of particles in each state; sort the result according to the state 
energies 



5.2 Ideal quantum gas: Grand canonical ensemble 

We may derive the properties of a quantum gas in another way, making use of the (z, V, T) 
ensemble in Gibbsean phase space. Recalling the general definition of the grand partition function, 
Z(z, V, T) = X)jv=o z N Q{N, V, T), we now write Q as a sum (in place of an integral) over states: 



Q(N,V,T) = 



m 



3JV 



Nlh 3N 



I 



(ffexp 



—E(T)/kT 



^exp 

{/*} 



J2fnE H /kT 



(5.5) 
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Figure 5.1: Playing the Fermi-Dirac game. [Code: EFRoulette] 



The sum {fa} is to be taken over all permitted population numbers of all states n, again requiring 
that J2n In = N. The permitted values of fn are: and 1 for fermions, and 0, 1, 2, . . . N for 
bosons. In this manner we arrive at 



Z = E E eX P - E fnEn/kT 

N=0 {f H } L n 

It is easy to show that this is equal to 



EEn( 

JV=0{/ fl } n 



-E H /kT 



fx 



E(- 



-Eft\f 



Now we can insert the possible values of /. We find that for 
Fermions (/ = 0, 1): 

n[ 



z = 



l + ze 



-E H /kT 



and for Bosons (/ = 0, 1, 2, . . .): 



Z = T\ 1 

11 l-ze- 



E r JkT 



(5.6) 



(5.7) 



(5.8) 



(5.9) 



Having secured the grand partition function, we can now apply the well-known formulae for 
pressure, mean particle number, and internal energy (see Section 4.3) to determine the thermo- 
dynamic properties of the system. The mean population number of a given state ft is 



(/ft) = J E E f* exp 



N {fn} 



E rtfn 



1 d 



hiZ 



(5.10) 



Inserting for Z the respective expression for Fermi or Bose particles we once more arrive at the 
population densities of equ. 5.4. 

In the following sections we discuss the properties of a few particularly prominent fermion 
and boson gases. 



5.3 Ideal Fermi gas 

Figure 5.2 shows the fermion population density (see equ. 5.4 with the positive sign in the de- 
nominator.) It is evidently quite different from its classical counterpart, the Boltzmann factor. In 
particular, when the temperature is low then it approaches a step function: in the limit kT — > 
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Figure 5.2: Mean population numbers of the states in a Fermi-Dirac system with fi = 0. For 
comparison we have also drawn the classical Boltzmann factor exp [— E/kT] for a temperature of 
kT = 5. 

all states having an energy below a certain value are inhabited, while the states with higher 
energies remain empty. The threshold energy Ep = is called "Fermi energy"' 



It is only for high temperatures and small values of /i that the Fermi-Dirac density approaches 
the classical Boltzmann density; and as it does so it strictly obeys the inequality Jfd < /b™- 
For the purpose of comparison we have included a graph of fsm — exp [—Ep/kT] in Figure 5.2. 



ELECTRONS IN METALS 

Conduction electrons in metallic solids may be considered as an ideal fermion gas - with an 
additional feature: since electrons have two possible spin states the maximum number of particles 
in a state p is 2 instead of 1. 

At low temperatures all states p with Ep < Ep = \i are populated. The number of such states 
is, as we can see from eq. 1.21, 



(5.11) 
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Bose-Einstein-Verteilungsdichte mit mu=0 
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Figure 5.3: Mean population number of states in a Bose-Einstein system with fi = 0. For 
comparison we include a graph of the classical density exp [— E/kT] at kT = 5. 

Assuming a value of /x « 5 • 10 -19 J typical for conduction electrons we find iV/V « 3 • 10 27 m~ 3 . 

Applying the general formulae 4.51 and 4.53 we may easily derive the pressure and internal 
energy of the electron gas. We may also recapture the relation PV — 2U/3, consistent with an 
earlier result for the classical ideal gas. 

5.4 Ideal Bose gas 

For bosons the mean population number of a state is 

to) - f = ^A-T (5-12) 

This function looks a bit like the Boltzmann factor oc e~ E fl kT but is everywhere larger than the 
latter. For small /j, and large T we again find that /b « /j m . 



PHOTONS IN A BOX 

A popular example for this type of system is a "gas" of photons. A box with an internal coating 
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of reflecting material in which a photon gas is held in thermodynamic equilibrium is often called 
a "black body" . Originally this name refers to a grain of black material that might be placed in 
the box to allow for absorption and re-emission of photons, thus enabling energy exchange and 
equilibration. In actual fact the internal walls of the box are never perfectly reflecting, rendering 
the insertion of a black body grain unnecessary. 

Since the total energy in the box is conserved and the photons may change their energy upon 
absorption and reemission, the total number of photons is not conserved. This is tantamount 
to assuming fi = 0. 

To determine the energy spectrum of the photons we first calculate the number dT, of states 
within a small energy interval. These states will then be populated according to equ. 5.12. A 
simple geometric consideration - how many lattice points are lying within a spherical shell - 
leads to 

8irVp 2 dp ^Vv 2 dv 
dX = = —j— (5.13) 

where p = hvjc is the momentum pertaining to the energy E — hv. The total number of photons 
in the system is thus 

N = j (U)** = ^ / ehv £r-l dv ^ 
and accordingly the number of photons in a frequency interval [v, du] is 

n{y ) dv = 8lT J _JL — dv (5.15) 

The amount of energy carried by these photons is the spectral density of black body radiation; 
it is given by 

. , , dE[y) . . . . , 8irV hv 3 , . . 

I(y)dv = _L2 = E (y)n(y)dv = — _^ dv (5.16) 

For pressure and internal energy of the photon gas we find - in contrast to the classical and Fermi 
cases - the relation PV — U/3. 

Providing an explanation for the experimentally measured spectrum of black body radiation 
was one of the decisive achievements in theoretical physics around 1900. Earlier attempts based 
on classical assumptions had failed, and it was Max Planck who, by the ad hoc assumption of 
a quantization of energy, could reproduce the correct shape of the spectrum. The subsequent 
efforts to understand the physical implications of that assumption eventually lead up to quantum 
physics. 



5.5 Problems for Chapter 5 



TEST YOUR UNDERSTANDING OF CHAPTER 5: 

5.1 Population densities: Explain the significance of the population densities for Fermi-Dirac 
and Bose-Einstcin statistics. Sketch these functions of energy at two temperatures. 

5.2 Classical limit: Starting from the Fermi-Dirac density discuss the classical limit of quantum 
statistics. 

5.3 Ideal quantum gases: Discuss two examples of ideal quantum gases. 



69 



Bibliography 



[Abramowitz 65] Abramowitz, M., Stegun, I. A., Hrsg.: Handbook of Mathematical Functions. 
Dover, New York, 1965. 

[Alder 57] Alder, B. J. und Wainwright, T. E., J. Chem. Phys. 27 (1957) 1208. 

[Alder 67] Alder, B. J., und Wainwright, T. E., Phys. Rev. Lett. 18 (1967) 988. 

[Allen 90] Allen, M.P., und Tildesley, D.J.: Computer Simulation of Liquids. Oxford University 
Press, 1990. 

[Binder 87] Binder, K.: Applications of the Monte Carlo Method in Statistical Physics. 
Springer, Berlin 1987. 

[Binder 92] Binder, K.: The Monte Carlo Method in Condensed Matter Physics. Springer, 
Berlin 1992. 

[Hansen 69] Hansen, J.-P., und Vcrlct, L., Phys. Rev. 184 (1969) 151. 

[Hoover 68] Hoover, W. C, und Ree, F. H., J. Chem. Phys. 49 (1968) 3609. 

[KALOS 86] Kalos, M. H., und Whitlock, P. A.: Monte Carlo Methods. Wiley, New York 1986. 

[Levesque 69] Levesque, D., und Verlet, L., Phys. Rev. 182 (1969) 307; Phys. Rev. A2/6 (1970) 
2514; - und K"urkij"arvi, J., Phys. Rev. A7/5 (1973) 1690. 

[Metropolis 49] Metropolis, N., und Ulam, S., J. Amer. Statist. Assoc. 44 (1949) 335. 

[Metropolis 53] Metropolis, N. A., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., und 
Teller, E., J. Chem. Phys. 21 (1953) 1087. 

[Papoulis 81] Papoulis, Athanasios: Probability, Random Variables and Stochastic Processes. 
McGraw-Hill International Book Company, 1981. 

[POSCH 87] Holian, B. L., Hoover, W. C, Posch, H. A., Phys. Rev. Lett. 59/1 (1987) 10. 

[Reif 90] Reif, Frederick: Statistische Physik (Berkeley Physik Kurs 5). Vieweg, Braunschweig 
1990. 

[Vesely 78] Vesely, F. J.: Computerexperimente an Fl" ussigkeitsmodellen. Physik Verlag, 
Weinheim 1978. 

[Vesely 94] Vesely, F. J.: Computational Physics - An Introduction. Plenum, New York 1994; 
2nd edn. Kluwer, New York 2001. 



70 



